Big Data Architect IT Consultant Master
New
J
JobgetherBig Data
Fully remote work arrangement within the United States.Full-TimeSenior
Salary75 - 80 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years of experience in modern Big Data platforms, architecture, Azure cloud solutions, and data platform operations; at least 3 years in APIs and web services, real-time streaming, data science tools, and ETL/data processing; at least 16 years planning, coordinating, and monitoring project activities and leading projects.
- Required Skills
- PythonSQLETLMicrosoft AzureNosqlDatabricks
Requirements
- Hold a bachelor's degree in Information Technology or a related field, or have equivalent professional experience.
- Have at least 5 years of experience implementing modern Big Data storage and analytics platforms, such as Databricks and Data Lakes.
- Have at least 5 years of practical experience in modern Big Data architecture, implementation principles, and best practices.
- Have at least 5 years of experience designing and implementing cloud networking, security, and storage solutions, particularly on Microsoft Azure.
- Have at least 5 years of experience managing data platform operations, including runtime environments, warehousing, pipelines, auditing, data sharing, cost management, and user administration.
- Have at least 5 years of experience deploying data tools and storage solutions on cloud platforms such as Microsoft Azure.
- Have at least 5 years of experience with data analysis and visualization systems, including Tableau, MicroStrategy, ArcGIS, Kibana, and Oracle.
- Have at least 5 years of experience querying structured and unstructured data using SQL and NoSQL databases, and modeling, ingesting, and transferring data through pipelines.
- Have at least 3 years of experience with APIs and web services, including REST and SOAP, and with complex event processing and real-time data streaming.
- Have at least 3 years of experience deploying and managing data science tools and modules, including Notebooks and R.
- Have at least 3 years of experience in ETL, data processing, and analytics using Python, Java, or R.
- Have at least 16 years of experience planning, coordinating, and monitoring project activities, and leading projects in compliance with established standards and procedures.
- Databricks Certified Data Engineer Professional certification is highly desirable.
Responsibilities
- Design and support an enterprise Big Data and Data Lake architecture using Databricks, Microsoft Azure, Azure Data Lake, Synapse, and related technologies.
- Coordinate IT project management, engineering, maintenance, quality assurance, and risk management activities.
- Plan, organize, coordinate, and monitor project activities against established objectives and standards.
- Develop and implement technical applications and data solutions for end users and enterprise operations.
- Establish, document, maintain, and enforce system design, development, installation, modification, and documentation standards.
- Oversee data platform runtime environments, warehouses, pipelines, auditing, data sharing, cost management, and user administration.
- Support data integration with Esri, Tableau, MicroStrategy, API gateways, and Oracle databases.
- Develop and maintain pipelines and ETL processes for structured and unstructured data sources.
- Monitor and troubleshoot platform and operational issues, perform application upgrades, and maintain reliability and performance.
- Provide training and guidance on system products, processes, and technical procedures.
View Full Description & ApplyYou'll be redirected to the employer's site
