Datalake Developer | SQL  

Duties & Responsibilities:

• Ability to bring data from multiple sources across all timelines with varying Quality of Service (QoS)
• Ability to take data from the storage tier and convert it to structured data for easier analysis by downstream applications
• Ability to run analytical algorithms and user queries with varying QoS (realtime, interactive, batch) to generate structured data for easier analysis by downstream applications
• Ability to integrate insights with business decisioning systems to build datadriven applications.
• Ability to manage the data lifecycle, access policy definition, and master data management and reference data management services
• Ability to monitor, configure, and manage the whole data lake from a single operations environment (Pivotal Command Center)
• Successful experience developing robust metadata driven ingestion solution with real time, near time and batch feeds.
• Successful experience developing SQL on Hadoop solutions using Hawq or similar for use in in-memory databases, GreenPlum Data Warehouse, etc.

Basic Technical Requirements

Agile project experience; Pivotal Big Data Suite or other Big Data development experience including Pivotal HD, GemFire XD, HAWQ, GreenPlum, Spring XD, Redis, J2EE, Metadata Management, Experience on Financial Services projects, Experience working on Large Programs, Data and Insights experience

Desirable Skills

Nice to have skills: Business Analysis, Project/team leadership, Data Architecture, Data Analysis, Data Management, Data Governance, Data Modeling