Skip to main content
Upload your CV and find your next job on Indeed!

Pyspark jobs in Mitraon, Delhi

Sort by: -
    • § B.E / B. Tech in Computer Science/IT/ or Masters in Computer Application(MCA).
    • Minimum 3 Years work experience in Big Data/Cloud Computing/ Data Engineering/…
    • View all Maruti Suzuki India Ltd jobs - Gurugram, Haryana jobs
    • Salary Search: Data Engineer salaries in Gurugram, Haryana
    • See popular questions & answers about Maruti Suzuki India Ltd
    • The ideal candidate should have experience with modern data engineering tools and frameworks, a strong understanding of data architecture and pipeline…
    • In this role, the candidate will be responsible for designing, developing, optimizing, and maintaining scalable data pipelines and workflows that support…
    • Automate, Industrialize the build and development tasks.
    • Lead discussion sessions with stakeholders.
    • Participate in all areas of the data Engineering life-cycle…
    • Design, develop, test, and support scalable data pipelines and ETL/ELT solutions using Azure Databricks, PySpark, SQL, and cloud-native technologies.
    • Ensure the software systems are scalable, reliable, and efficient.
    • Protect data and applications by implementing robust security measures.
    • PayPay India is looking for a Data Engineer to work on our payment system to deliver the best payment experience for our customers.
    • We design, build, and operate scalable data platforms that support critical business decisions across multiple domains.
    • Binlog/wal/gtid log replication.
    • The ideal candidate should have deep expertise in Databricks, Apache Spark, PySpark, Python, SQL, and cloud platforms (AWS, Azure, or GCP), along with a proven…
    • Project Role Description : -Resource should have 5+ years of work exp.
    • Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on…
    • 2-3 years of strong exp. in established data technologies viz.
    • Data ingestion, ETL, and data warehouse, CDC and Event Streaming technologies.
    • Design and develop ETL/ELT pipelines using Azure Data Factory, Snowflake,.
    • Build and maintain data integration workflows from various data sources to.
    • Mechademy is hiring a Senior Data Engineer to build and scale reliable data platforms, pipelines, and models that power enterprise AI, machine learning, and…
    • We partner with customers to modernize data platforms, accelerate time-to-insight, and enable governed, scalable data architectures.
    • Saarthee is based out of Philadelphia, USA with office in UK and India.
    • As a Data Engineer, you will be responsible for designing and developing robust data…

People also searched:

data engineer

Job Post Details

Data Engineer
Gurugram, Haryana
Full-time

Job details

Pay information not provided
Full-time
Gurugram, Haryana

Full job description

Essential :
§ B.E / B. Tech in Computer Science/IT/ or Masters in Computer Application(MCA)

§ Minimum 60 % marks

Minimum 3 Years work experience in Big Data/Cloud Computing/ Data Engineering/ Analytics related projects.

Desirable:
§ Certification in Big Data/Data Science/Cloud Computing or equivalent.

Role:
Data Engineering & Quality Management : Design, implementation, and management of data platform, data pipelines to help fulfill data access and aggregation functionality for users in cloud environment.

Develop and Maintain Data Pipelines: Design, build, and manage scalable data pipelines for data extraction, transformation, and loading (ETL).

Data Integration: Integrate data from various sources, ensuring data quality and consistency.

Optimize Data Systems: Identify and implement process improvements to enhance data reliability, efficiency, and quality.

Collaborate with Teams: Work with data scientists, analysts, and other stakeholders to support their data infrastructure needs.

Monitor and Troubleshoot: Monitor data pipelines and systems, troubleshoot issues, and ensure data integrity.

Documentation: Maintain comprehensive documentation of data processes and systems.

Technical/ Functional:
Experience: 3-5 years of experience in data engineering or a related field.

Technical Skills: Proficiency in Py-Spark (Must Have), SQL, Python, and data platform like Databricks.

Storage Management: Experience in storage mechanism in AWS S3, Layers of Medallion Architecture, OTF like Delta, iceberg etc., Hand-Ons in Data schema like Star, snowflake etc.

§ Good knowledge next generation ETL/ELT tools and data consolidation frameworks that enable capabilities within the data ecosystem.

§ Ability to work independently or within a team, proactively, in a fast-paced AGILE-SCRUM environment.

Desired but not essential :
§ Experience in IoT time series data domain

§ Exposure to automotive data.

Behavioral

§ Effective team player.

§ Study industry trends (global and domestic) and apply it in work-area.

§ Co-ordinate department activities and represent department / MSIL in forums.

Good communication and presentation skills.

Search Keywords

  • Data Engineer
  • Databricks
  • PySpark
  • Python
  • SQL
  • Process Automation
  • Data Visualization
  • Database Management
  • Warehousing
  • IOT
  • Databricks
  • AWS
Let Employers Find YouUpload Your Resume