Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

Wno1OUQ5UVhPQmc3ZDRTdytCSm9ORk5KcFE9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

EY

Senior Counsel Technology & Managed Services (Boston) Job at EY

A global professional services firm is looking for an experienced Assistant General Counsel for Technology and Managed Services. This role requires a seasoned professional with a minimum of 8 years of complex services and technology transactional experience. Responsibilities...

Tink

Commercial Counsel U.S. Payments & Deals (San Francisco) Job at Tink

A leading global payments technology company is seeking a passionate attorney to join their Legal and Ethics & Compliance group. The successful candidate will play a key role in contract negotiations and provide strategic legal guidance in a fast-paced environment. Applicants...

Multnomah County

Office Assistant 2- District Attorney's Office Job at Multnomah County

 ...day to serve the public, support victims of crime, and pursue justice. Whether you're managing sensitive documents, assisting the public...  ...Unit is responsible for preparing police reports and other criminal case records for distribution to defense attorneys. Records/... 

St. Louis Park Public Schools

Custodian 2 Night Floater Job at St. Louis Park Public Schools

Title: Custodian 2 Night Floater DBM Classification: A12/Grade 2 Department: Buildings & Grounds Salary Range: $19.33 - $25.06 Employee Group: Custodial Prepared Date: December 2025 Reports to: Facilities Coordinator FTE/ FLSA Status...

Talkiatry

Psychiatrist Job at Talkiatry

Talkiatry is led clinically by Dr. Georgia Gaveras, a board-certified child, adolescent and adult psychiatrist with an additional board-certification in addiction medicine. At Talkiatry, that means our psychiatrists are in control of their practice. Our support staff...