Big Data Engineer
New
United StatesFull-TimeEntry
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 0-2 Years
- Required Skills
- PythonSQLNumpyApache KafkaData engineeringPandasPySpark
Requirements
- 0-2 years of relevant experience (coursework, competitions, internships, or job experience).
- Proficiency in Python 3, specifically with Numpy and Pandas libraries.
- Proven experience developing data engineering pipelines on real-world problems.
- Expertise in implementing advanced SQL queries.
- Ability to develop complex logic using Python 3.
- Commitment to learn PySpark or Kafka within one month of joining.
- Proactive and responsive communication style for an accelerated interview process.
- Ability to work effectively as an individual contributor in a startup or lean team environment.
- Immediate availability to join.
Responsibilities
- Build data acquisition pipelines ingesting data from various source systems such as databases, flat files, and APIs.
- Develop data munging pipelines to transform data format, shape, and value.
- Convert and refactor existing Python codes into functional programming syntax.
- Implement data structures, linear algebra, and algorithms at scale on parallel or distributed clusters.
- Apply best practices to identify and resolve memory constraints, runtime issues, and performance bottlenecks.
View Full Description & ApplyYou'll be redirected to the employer's site
