Big data developer developer developer Jobs

[Applicants: Over 200 applicants | Industry: IT Services and IT Consulting | Type: Full-time | Level: Mid-Senior level] About PersistentWe are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep techni

[Industry: Financial Services | Type: Full-time | Level: Not Applicable] Job DescriptionThis is your chance to change the path of your career and work at one of the world's leading financial institutions.As a Software Engineer for Big Data and Analytics at JPMorgan Chase within Consumer and Community Banking Data Technology, you will be an integral part of an agile team that enhances, builds, and delivers trusted, market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you will be responsible for delivering critical technology solutions across multiple technical areas and business functions, supporting the firm’s objectives using Java, J2EE, Microservices, Python, Spark, Scala, and AWS for Business Banking Data Products.Job ResponsibilitiesOversee all aspects of data strategy, governance, data risk management, reporting, and analytics.Manage risks associated with data use, retention/destruction, and privacy.Design, develop, code, test, debug, and deploy scalable and extensible applications.Produce high-quality code utilizing Test Driven Development techniques.Participate in retrospectives to drive continuous improvement within the feature team.Participate in code reviews, ensuring all solutions align with pre-defined architectural specifications.Implement automation through Continuous Integration and Continuous Delivery.Manage cloud development and deployment, supporting applications in both private and public clouds.Required Qualifications, Capabilities, And SkillsFormal training or certification in software engineering concepts and 5+ years of applied experience.Advanced knowledge of architecture, design, and business processes.Full Software Development Life Cycle experience within an Agile framework.Expert-level skills in Java, AWS, database technologies, Python, Scala, Spark/PySpark, or any ETL technology.Experience developing and decomposing complex SQL on RDMS platforms.Experience with Data Warehousing concepts (including Star Schema).Practical experience delivering projects in Data and Analytics, Big Data, Data Warehousing, and Business Intelligence; familiarity with relevant technological solutions and industry best practices.Strong understanding of data engineering challenges and proven experience with data platform engineering (batch and streaming, ingestion, storage, processing, management, integration, consumption).Familiarity with multiple Data & Analytics technology stacks.Awareness of va...

[Applicants: Be among the first 25 applicants | Industry: Financial Services | Type: Full-time | Level: Not Applicable] Job DescriptionJob responsibilitiesDesign & build new applications utilizing leading edge technologies and modernize existing app

Full Stack Developer – Cloudera (Big Data)Freelance | Long-termAbout the ProjectShakers is supporting Reply in sourcing seniorFull Stack Developersfor alarge-scale Big Data & energy platform, operating in a high-volume, mission-critical environment.R

Have mastered data modeling and parallel processing concepts, and have solid knowledge of Big Data technologies (e.g., Apache Spark) and distributed data storage systems (e.g., Scylla DB). Have already designed and optimized data processing pipelines using tools like Airflow.

Passionate about tackling big data challenges in distributed systems. Adaptable and versatile, taking on multiple roles as needed, whether as a Platform Engineer, Data engineer, Backend engineer, DevOps engineer, or support engineer.

Experience in building data pipelines Experience in developing/designing micro-service architecture. Experience in developing applications in Spring & Spring Boot Working knowledge of Jenkins CI, Git, JIRA Ability to seek improvements to all aspects of the development process Show less [{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-auvik-4344834952","jobId":"4344834952","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-driver-at-lyft-4344455919","jobId":"4344455919","label":"Data Engineer, Driver"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-tactable-4353160568","jobId":"4353160568","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-science-engineer-at-adobe-4346190927","jobId":"4346190927","label":"Data Science Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-ravl-4329183177","jobId":"4329183177","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-bluematrix-4358125625","jobId":"4358125625","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-techdoquest-4355332663","jobId":"4355332663","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-opentable-4326333020","jobId":"4326333020","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-syndesus-inc-4365046958","jobId":"4365046958","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-tiger-analytics-4371291586","jobId":"4371291586","label":"Data Engineer"},{"type":"similar_search","href":"https://www..com/jobs/financial-software-engineer-jobs","label":"Empleos de Desarrollador de software financiero"},{"type":"similar_search","href":"https://www..com/jobs/hadoop-developer-jobs","label":"Empleos de Desarrollador de Hadoop"},{"type":"similar_search","href":"https://www..com/jobs/senior-data-engineer-jobs","label":"Empleos de Ingeniero de Datos Senior"},{"type":"similar_search","href":"https://www..com/jobs/head-librarian-jobs","label":"Emple...

InfoCentric is one of the largest Australian-owned specialist Data Consultancy, specialising in Cloud Data Platforms, Analytics and AI. At InfoCentric, we deliver leading solutions in Data Strategy and Advisory, Cloud Data Platforms, Artificial Intelligence, GenAI, and Business Analytics and Insights to Australia's largest organisations.

Knowledge about data science tools and libraries. We will be happy to work with applicants requesting accommodation at any stage of the hiring process Show less [{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-auvik-4344834952","jobId":"4344834952","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-driver-at-lyft-4344455919","jobId":"4344455919","label":"Data Engineer, Driver"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-tactable-4353160568","jobId":"4353160568","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-science-engineer-at-adobe-4346190927","jobId":"4346190927","label":"Data Science Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-ravl-4329183177","jobId":"4329183177","label":"Data Engineer"},{"type":"people_also_viewed","href":"https://ca..com/jobs/view/data-engineer-at-bluematrix-...

🔍 Big Data Application Developer – Expert 📍 Toronto, ON 🕒 12-Month Contract We are looking for a Big Data Application Developer (Expert) to design, build, and evolve large-scale, cloud-native data platforms supporting advanced analytics, data science, and enterprise reporting. 🚀 What You’ll Do Design and build scalable, cloud-native data platforms supporting Data Engineering, Data Science, and BI workloads Develop and deploy batch and event-driven data pipelines using technologies such as Spark, NiFi, Kafka, and Airflow Work across modern cloud platforms including Databricks, Azure, and Snowflake Implement and support DevOps, DataOps, and MLOps practices to ensure reliable, high-quality data products Ensure data security and governance standards are applied across all environments Provide L3 production support for the data platform technology stack Lead proof-of-concepts for hybrid cloud architectures integrating on-prem and cloud solutions Collaborate using Agile and design-thinking principles with engineering and business stakeholders Stay current with emerging data engineering technologies and trends ✅ Must-Have Qualifications Bachelor’s degree in Computer Science, Information Technology, or related field 10+ years of experience developing large-scale, mission-critical applications 10+ years across the full SDLC (architecture, development, testing, deployment) Deep expertise with Big Data platforms such as Hadoop/Hive or columnar databases (ParAccel, Vertica, Sybase IQ) 10+ years of Big Data development experience in Financial Services 3–5 years hands-on experience with Spark, Python, NiFi, Kafka, Airflow, and cloud data platforms (Databricks, Snowflake) 2–3 years of system administration experience with Docker and Kubernetes Strong experience with UNIX/Linux environments and shell scripting Advanced SQL skills and proficiency in Java, Scala, and/or Python Experience with DevOps tools, automation, and DataOps practices A continuous-learning mindset and comfort working on complex, ambiguous problems ⭐ Nice to Have Experience with OpenShift, S3, Trino, Ranger, Hive Knowledge of networking, information security, and vulnerability management Experience building dashboards with Prometheus and Grafana Familiarity with data science tools and libraries Mindlance is an equal opportunity employer.