We use cookies to personalize content and ads, analyze traffic and improve our services. We also use essential cookies to inform employers of clicks to their jobs. You acknowledge that your use of Indeed is subject to our updated Privacy Policy, Cookie Policy, and Terms, which we encourage you to review.
Pyspark jobs in Mitraon, Delhi
Sort by: relevance - date
- Maruti Suzuki India LtdGurugram, Haryana
- § B.E / B. Tech in Computer Science/IT/ or Masters in Computer Application(MCA).
- Minimum 3 Years work experience in Big Data/Cloud Computing/ Data Engineering/…
- View all Maruti Suzuki India Ltd jobs - Gurugram, Haryana jobs
- Salary Search: Data Engineer salaries in Gurugram, Haryana
- See popular questions & answers about Maruti Suzuki India Ltd
- Skyleaf ConsultantsGurugram, Haryana
- Ensure the software systems are scalable, reliable, and efficient.
- Protect data and applications by implementing robust security measures.
- PayUGurugram, Haryana
- We design, build, and operate scalable data platforms that support critical business decisions across multiple domains.
- Binlog/wal/gtid log replication.
- View all PayU jobs - Gurugram, Haryana jobs - Data Engineer jobs in Gurugram, Haryana
- Salary Search: Associate Data Engineer salaries in Gurugram, Haryana
- See popular questions & answers about PayU
- Orange BusinessGurugram, Haryana
- Automate, Industrialize the build and development tasks.
- Lead discussion sessions with stakeholders.
- Participate in all areas of the data Engineering life-cycle…
- PayPay IndiaGurugram, Haryana
- PayPay India is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our customers.
- Ananta ServicesGurugram, Haryana
- We are looking for an experienced AWS Data Engineer (ETL & DWH) with strong hands-on expertise in AWS cloud services, data ingestion, ETL pipeline development…
- IMPRONICS DIGITECH PRIVATE LIMITEDGurugram, Haryana
- The ideal candidate should have deep expertise in Databricks, Apache Spark, PySpark, Python, SQL, and cloud platforms (AWS, Azure, or GCP), along with a proven…
- EXL ServiceGurugram, Haryana
- Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake,.
- Build and maintain data integration workflows from various data sources to.
- Dinero SolutionsGurugram, Haryana
- 2-3 years of strong exp. in established data technologies viz.
- Data ingestion, ETL, and data warehouse, CDC and Event Streaming technologies.
- METADESIGN SOLUTIONSGurugram, Haryana
- We partner with customers to modernize data platforms, accelerate time-to-insight, and enable governed, scalable data architectures.
- CLANXGurugram, Haryana
- Mechademy is hiring a Senior Data Engineer to build and scale reliable data platforms, pipelines, and models that power enterprise AI, machine learning, and…
- OptumGurugram, Haryana
- Design, build and maintain scalable batch and streaming data pipelines on Azure and Databricks using the Medallion Architecture (Bronze, Silver, Gold) on Delta…
- AccentureGurugram, Haryana
- Project Role Description : -Resource should have 5+ years of work exp.
- Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on…
- View all Accenture jobs - Gurugram, Haryana jobs
- Salary Search: Data Engineer salaries in Gurugram, Haryana
- See popular questions & answers about Accenture
- SaartheeGurugram, Haryana
- Saarthee is based out of Philadelphia, USA with office in UK and India.
- As a Data Engineer, you will be responsible for designing and developing robust data…
- View all Saarthee jobs - Gurugram, Haryana jobs
- Salary Search: Data Engineer salaries in Gurugram, Haryana
- SaartheeGurugram, Haryana
- Saarthee is based out of Philadelphia, USA with office in UK and India.
- As a Data Engineer, you will be responsible for designing and developing robust data…
- View all Saarthee jobs - Gurugram, Haryana jobs
- Salary Search: Data Engineer salaries in Gurugram, Haryana
View similar jobs with this employerBain & Company IncDelhi, Delhi- ECD plays a critical role as it adds value to Bain's case teams globally by supporting them with analytics and research solutioning across all industries,…
Job Post Details
Data Engineer
Job details
Pay information not provided
Full-time
Gurugram, Haryana
Full job description
Essential :
§ B.E / B. Tech in Computer Science/IT/ or Masters in Computer Application(MCA)
§ Minimum 60 % marks
Minimum 3 Years work experience in Big Data/Cloud Computing/ Data Engineering/ Analytics related projects.
Desirable:
§ Certification in Big Data/Data Science/Cloud Computing or equivalent.
Role:
Data Engineering & Quality Management : Design, implementation, and management of data platform, data pipelines to help fulfill data access and aggregation functionality for users in cloud environment.
Develop and Maintain Data Pipelines: Design, build, and manage scalable data pipelines for data extraction, transformation, and loading (ETL).
Data Integration: Integrate data from various sources, ensuring data quality and consistency.
Optimize Data Systems: Identify and implement process improvements to enhance data reliability, efficiency, and quality.
Collaborate with Teams: Work with data scientists, analysts, and other stakeholders to support their data infrastructure needs.
Monitor and Troubleshoot: Monitor data pipelines and systems, troubleshoot issues, and ensure data integrity.
Documentation: Maintain comprehensive documentation of data processes and systems.
Technical/ Functional:
Experience: 3-5 years of experience in data engineering or a related field.
Technical Skills: Proficiency in Py-Spark (Must Have), SQL, Python, and data platform like Databricks.
Storage Management: Experience in storage mechanism in AWS S3, Layers of Medallion Architecture, OTF like Delta, iceberg etc., Hand-Ons in Data schema like Star, snowflake etc.
§ Good knowledge next generation ETL/ELT tools and data consolidation frameworks that enable capabilities within the data ecosystem.
§ Ability to work independently or within a team, proactively, in a fast-paced AGILE-SCRUM environment.
Desired but not essential :
§ Experience in IoT time series data domain
§ Exposure to automotive data.
Behavioral
§ Effective team player.
§ Study industry trends (global and domestic) and apply it in work-area.
§ Co-ordinate department activities and represent department / MSIL in forums.
Good communication and presentation skills.
Search Keywords
§ B.E / B. Tech in Computer Science/IT/ or Masters in Computer Application(MCA)
§ Minimum 60 % marks
Minimum 3 Years work experience in Big Data/Cloud Computing/ Data Engineering/ Analytics related projects.
Desirable:
§ Certification in Big Data/Data Science/Cloud Computing or equivalent.
Role:
Data Engineering & Quality Management : Design, implementation, and management of data platform, data pipelines to help fulfill data access and aggregation functionality for users in cloud environment.
Develop and Maintain Data Pipelines: Design, build, and manage scalable data pipelines for data extraction, transformation, and loading (ETL).
Data Integration: Integrate data from various sources, ensuring data quality and consistency.
Optimize Data Systems: Identify and implement process improvements to enhance data reliability, efficiency, and quality.
Collaborate with Teams: Work with data scientists, analysts, and other stakeholders to support their data infrastructure needs.
Monitor and Troubleshoot: Monitor data pipelines and systems, troubleshoot issues, and ensure data integrity.
Documentation: Maintain comprehensive documentation of data processes and systems.
Technical/ Functional:
Experience: 3-5 years of experience in data engineering or a related field.
Technical Skills: Proficiency in Py-Spark (Must Have), SQL, Python, and data platform like Databricks.
Storage Management: Experience in storage mechanism in AWS S3, Layers of Medallion Architecture, OTF like Delta, iceberg etc., Hand-Ons in Data schema like Star, snowflake etc.
§ Good knowledge next generation ETL/ELT tools and data consolidation frameworks that enable capabilities within the data ecosystem.
§ Ability to work independently or within a team, proactively, in a fast-paced AGILE-SCRUM environment.
Desired but not essential :
§ Experience in IoT time series data domain
§ Exposure to automotive data.
Behavioral
§ Effective team player.
§ Study industry trends (global and domestic) and apply it in work-area.
§ Co-ordinate department activities and represent department / MSIL in forums.
Good communication and presentation skills.
Search Keywords
- Data Engineer
- Databricks
- PySpark
- Python
- SQL
- Process Automation
- Data Visualization
- Database Management
- Warehousing
- IOT
- Databricks
- AWS
Let Employers Find YouUpload Your Resume