Python + PySpark - Junior Developer Job at Compunnel, Inc., New York, NY

Wno1OUQ5UVhPQmc3ZDRTdytCSm9ORk5KcFE9PQ==
  • Compunnel, Inc.
  • New York, NY

Job Description

The Python + PySpark Junior Developer will be responsible for developing scalable data solutions using PySpark and Python. The role requires hands-on experience in data engineering, SQL, and cloud platforms such as AWS or Azure. The candidate should have strong problem-solving skills and experience in building efficient ETL pipelines for large-scale data processing. Key Responsibilities Develop and maintain data processing pipelines using Python and PySpark Design and implement ETL workflows for structured and unstructured data Optimize data storage, retrieval, and transformation processes Work with cloud platforms (AWS or Azure) to deploy and manage data solutions Write complex SQL queries for data transformation and analysis Collaborate with data engineers, analysts, and stakeholders to ensure data integrity and reliability Troubleshoot and resolve performance issues in data pipelines Required Qualifications 5+ years of experience in data engineering Strong proficiency in Python and object-oriented programming Hands-on experience with PySpark for large-scale data processing Proficiency in SQL for data manipulation and query optimization Experience with cloud platforms (AWS or Azure) Knowledge of ETL processes and data warehousing concepts Experience with Hadoop is acceptable Preferred Qualifications Experience in optimizing Spark jobs for performance and efficiency Familiarity with DevOps practices for data engineering Understanding of data governance and security best practices #J-18808-Ljbffr Compunnel, Inc.

Job Tags

Similar Jobs

Geisinger

OB/GYN Nurse Practitioner or Physician Assistant Job at Geisinger

 ...Job Title: OB/GYN Nurse Practitioner or Physician Assistant Location: Wilkes-Barre, Pennsylvania Job Category: Nurse Practitioner, Physician Assistant, Advanced Practice Schedule: Days Work Type: Full time Department: Maternal Fetal Medicine Division... 

Johnson Controls

Fire Alarm Technician Job at Johnson Controls

Join Johnson Controls, a world leader in pioneering smart building solutions, as a Fire Alarm Technician in our Safety and Law Enforcement sector. We're committed to enhancing building efficiency, sustainability, and security globally. This role is crucial for maintaining... 

Twin Cities Pain Clinic

Prior Authorization Specialist Job at Twin Cities Pain Clinic

 ...Position Title: Prior Authorization Specialist Supervisor: Prior Authorization Manager FLSA Status: Non-Exempt Mission: To provide our patients and community the most innovative and breakthrough treatment options to improve overall health and wellness.... 

Lend-A-Loan LLC

Mortgage Consultant - Entry-Level Job at Lend-A-Loan LLC

 ...Description Job Description Launch Your Mortgage Career with Lend-A-Loan! Ready to kickstart a career with...  ...-A-Loan , were hiring motivated, entry-level Mortgage Consultants who want to...  ...help you become a Licensed Loan Officer with all the tools you need to... 

Mayo Clinic

Dialysis Technician Job at Mayo Clinic

 ...Renal Dialysis Technician The Renal Dialysis Technician is responsible for providing patient care for patients receiving dialysis treatments. The Renal Dialysis Technician is responsible for providing direct patient care under the supervision of the RN and is responsible...