IBM is looking for Big Data Engineer in Pune, India. Candidates with a Bachelor’s Degree are eligible to apply for this position. The complete information, eligibility criteria, and requirements are provided below.
Job Description:
| Company Name | IBM |
| Position | Big Data Engineer |
| Qualifications | Bachelor’s Degree |
| Batch | 2018/ 2019/ 2020/ 2021/ 2022/ 2023 |
| Experience | 0 – 1 (Years) |
| Location | Pune, India |
Key Responsibilities:
- Based on the needs of our clients’ businesses, we design, develop, optimise, and maintain new and current data models and ETL processes.
- Create, implement, and maintain data infrastructure that is capable of meeting the demands of a data-driven corporation that is expanding quickly.
- To give data scientists and analysts easy access to data whenever they need it, coordinate data access and security.
Eligibility Criteria:
- Comprehension of Devops
- Familiarity in developing scalable end-to-end data ingestion and processing solutions
- Programming languages like Python, Java, and Scala that are object-oriented or functional
Preferred skills:
- Developed the Pysprk code for EMR and AWS Glue tasks. I worked on a scalable distributed data system using the MapR distribution and the Hadoop ecosystem in AWS EMR.
- Created data analysis programmes in Python and PySpark. Possessing solid Python development skills to create a custom rule-generating framework (just like rules engine).
- Python-based Hadoop streaming jobs were created for integrating apps that supported the Python API.
- The solution is designed to be implemented using Pyspark and the data from HBase is gathered using Python code. Business transformations were carried out using Apache Spark DataFrames/RDDs, while read/write operations were carried out using Hive Context objects.
- Rewriting a few Hive queries to Spark SQL will shorten the batch time.
About Company:
The IBMer is by far IBM’s greatest creation. For our clients and partners around the world, we think that the promise of an open hybrid cloud and AI approach can be realised by applying intelligence, reason, and science to enhance business, society, and the human condition.
Since 1911, we have been continuously innovating, making us not only one of the largest corporations in the world but also one of the greatest employers in the technology and consulting industries, with many of the Fortune 50 firms relying on the IBM Cloud to manage their operations.
How To Apply?
- First, read through all of the job details on this page.
- Scroll down and press the Click Here text.
- To be redirected to the official website, click on the apply link.
- Fill the details with the information provided.
- Before submitting the application, cross-check the information you’ve provided.
