Clevertech is a leading consultancy that is on a mission to build transformational digital solutions for the world&rsquo;s most innovative organizations. Enterprise companies turn to Clevertech to help them launch innovative digital products that interact with hundreds of millions of customers, transactions and data points. By partnering with Clevertech these companies are propelling forward and changing their industries, business models and more. About Clevertech We're Clevertech, since 2000, we have been consulting for and building core operating technologies, mobile apps and complex web applications that drive business growth for startups and Fortune 500 companies alike. Our clients' hardest problems are our favorite problems. Requirements <ul> <li>Experience developing ETL, data pipelines with devops as code</li> <li>Real world experience with Streamset</li> <li>Hands-on Snowflake or similar data warehouse experience with storage, networking and pipelines.</li> <li>Well-versed in the strategies required to help provide value and meaningful insight to clients.</li> </ul> Working at Clevertech At Clevertech, you can expect that you will: <ul> <li>Be 100% dedicated to one project at a time so that you can hone your skills, innovate and grow</li> <li>Be a part of a team of talented and friendly senior level developers</li> <li>Work on projects that allow you to use exciting, cutting edge tech. We believe in constantly evolving your mastery</li> </ul> The result? We produce meaningful work and we are truly proud and excited to be creating waves in an industry under transformation. Our Benefits We know that people do their best work when they&rsquo;re taken care of. So we make sure to offer great benefits. <ul> <li>Fully remote role in fully remote company</li> <li>Competitive salaries</li> <li>PTO</li> <li>Flexible Family Leave</li> <li>Annual Financial Allowance for YOUR development</li> <li>Strong Clevertech Community</li> <li>Clevertech U (Leadership Program, Habit Building, New Skills Training)</li> <li>Clevertech Gives Back Program</li> </ul> Getting Hired Our team is made up of people that are not only from different countries, but also from diverse backgrounds and disciplines. Our focus on employing respectful, introspective and collaborative talent is what powers our company and our success. Interested in exploring your future in this role and Clevertech? Set yourself up for success and take a look at our&nbsp;<a href="https://www.clevertech.biz/thoughts/interviewing-with-clevertech" rel="nofollow">Interview Process</a>&nbsp;before getting started! If you want to meet and learn about our CleverPeople's experience working at Clevertech,&nbsp;<a href="https://www.youtube.com/channel/UC_xY8p1vCP39eeDUPyDY1OA" rel="nofollow">click here</a>. The best people in tech just happen to be all over the world. Are you one of them? APPLY NOW

python

amazon-web-services

snowflake

[100% REMOTE] Sr. Snowflake Data Engineer

Clevertech is a leading consultancy that is on a mission to build transformational digital solutions for the world&rsquo;s most innovative organizations. Enterprise companies turn to Clevertech to help them launch innovative digital products that interact with hundreds of millions of customers, transactions and data points. By partnering with Clevertech these companies are propelling forward and changing their industries, business models and more. About Clevertech We're Clevertech, since 2000, we have been consulting for and building core operating technologies, mobile apps and complex web applications that drive business growth for startups and Fortune 500 companies alike. Our clients' hardest problems are our favorite problems. Requirements <ul> <li>5+ years experience in a senior developer role; ideally, you have delivered business critical software to large enterprises</li> <li>You are fluent in Python</li> <li>Experience creating data pipelines and backend aggregations</li> <li>Experience with ETL workflows on data pipelines</li> <li>You are comfortable manipulating large data sets and handle raw SQL</li> <li>Serverless experience with AWS lambda or Azure functions</li> <li>Strong communicator and fluent in English with excellent written and verbal communication skills</li> </ul> Working at Clevertech At Clevertech, you can expect that you will: <ul> <li>Be 100% dedicated to one project at a time so that you can hone your skills, innovate and grow</li> <li>Be a part of a team of talented and friendly senior level developers</li> <li>Work on projects that allow you to use exciting, cutting edge tech. We believe in constantly evolving your mastery</li> </ul> The result? We produce meaningful work and we are truly proud and excited to be creating waves in an industry under transformation. Our Benefits We know that people do their best work when they&rsquo;re taken care of. So we make sure to offer great benefits. <ul> <li>Fully remote role in fully remote company</li> <li>Competitive salaries</li> <li>PTO</li> <li>Flexible Family Leave</li> <li>Annual Financial Allowance for YOUR development</li> <li>Strong Clevertech Community</li> <li>Clevertech U (Leadership Program, Habit Building, New Skills Training)</li> <li>Clevertech Gives Back Program</li> </ul> Getting Hired Our team is made up of people that are not only from different countries, but also from diverse backgrounds and disciplines. Our focus on employing respectful, introspective and collaborative talent is what powers our company and our success. Interested in exploring your future in this role and Clevertech? Set yourself up for success and take a look at our&nbsp;<a href="https://www.clevertech.biz/thoughts/interviewing-with-clevertech" rel="nofollow">Interview Process</a>&nbsp;before getting started! If you want to meet and learn about our CleverPeople's experience working at Clevertech,&nbsp;<a href="https://www.youtube.com/channel/UC_xY8p1vCP39eeDUPyDY1OA" rel="nofollow">click here</a>. The best people in tech just happen to be all over the world. Are you one of them? APPLY NOW

database

[100% REMOTE] Sr. Python Data Engineer

In this role you can expect to grow and gain a huge amount of experience in Javascript, Node.JS, OpenBanking, AWS (particularly Athena and SageMaker), Kubernetes, Elastic stack &amp; API development. We&rsquo;re looking for candidates who are willing to learn (rather than being experts in these areas), but it&rsquo;s great if you already have experience with a few things on our list, especially those in your preferred area of the development stack. You&rsquo;ll thrive using agile methods and enjoy working openly, collaboratively and as part of a multidisciplinary team focused on one or more projects, doing things the right way and producing high quality code. Your work on our platform will help people get on top of their finances and make better informed financial decisions. As a member of our technical team you&rsquo;ll: <ul> <li> Design and build REST APIs to expose generated insights. </li> <li> Configure and deploy real-time flows from production services into the data warehouse. </li> <li> Implement services, using already developed machine learning and statistical techniques, that run efficiently over millions of banking transactions. </li> <li> Design and implement SQL queries to show key information for platform billing, user trends and in-app nudge generation.&nbsp; </li> </ul> And more generally you&rsquo;ll: <ul> <li> Increase code quality by actively participating in peer code review </li> <li> Improve our processes and tools through communication, automation and optimisation </li> <li> Build automated tests as part of our continuous integration and deployment environment </li> <li> Share knowledge of tools, techniques, new features and ideas with the Moneyhub team of developers and non developers </li> <li> Apply broad knowledge of web technologies to provide security, performance and scalability </li> <li> Solve issues and suggest solutions as part of feature development and support </li> </ul> Who you are We&rsquo;re interested in people who: <ul> <li> Have experience in back end Javascript development </li> <li> Understand software design principles such as functional programming (we use Ramda extensively) </li> <li> Are fluent in SQL. </li> <li> Have familiarity with techniques to deal with large volumes of data and/or throughput. &nbsp;For instance, you may have used data warehouses such as AWS Athena, Redshift or technologies in the Hadoop ecosystem. </li> <li> Have built ETL pipelines as part of an organisation&rsquo;s data warehousing strategy. </li> <li> Have worked with microservices interacting via REST APIs and through message queues. </li> <li> Are familiar with different database engines; we use PostgreSQL and MongoDB for OLTP processing. </li> </ul> And more generally: <ul> <li> Enjoy researching and learning new programming tools and techniques and telling others about them </li> <li> Communicate with accuracy and effectiveness </li> <li> Take a systematic approach to solve problems </li> <li> Have experience of using testing to validate solutions. </li> <li> Understand agile environments and version control </li> <li> Have a firm understanding of web security </li> <li> Are aware of technologies used for web applications, e.g databases, backups, CDNs and search, and of Unix-like operating systems, e.g. Linux and/or Mac OS </li> <li> Have experience of working on, or with modern web technologies </li> <li> Are familiar with working practices such as TDD, continuous integration, continuous delivery and DevOps (and want to learn more). </li> </ul> While not essential for the role, there will be the opportunity to: <ul> <li> Package and deploy Machine Learning models using Python, Scikit-learn and AWS Sagemaker. </li> <li> Develop front-end dashboards in React to display the results of analysis and to enable decision making by the business. </li> </ul>

node.js

Data Team Software Engineer

Clevertech is a leading consultancy that is on a mission to build transformational digital solutions for the world&rsquo;s most innovative organizations. Enterprise companies turn to Clevertech to help them launch innovative digital products that interact with hundreds of millions of customers, transactions and data points. By partnering with Clevertech these companies are propelling forward and changing their industries, business models and more. The problems we solve everyday are real and require creativity, grit and determination. We are building a culture that challenges norms while fostering experimentation and personal growth. We are hiring team members who are passionate and energized by the vision of empowering our customers in a complex industry through technology, data and a deep understanding of client concerns. In order to grasp the scale of problems we face, ideally you have some exposure to Logistics, FinTech, Transportation, Insurance, Media or other complex multifactor industries. REQUIREMENTS: <ul> <li>5+ years experience in a senior developer role; ideally, you have delivered business critical software to large enterprises</li> <li>You are fluent in Python</li> <li>Experience creating data pipelines and backend aggregations</li> <li>Experience with ETL workflows on data pipelines</li> <li>You are comfortable manipulating large data sets and handle raw SQL</li> <li>Serverless experience with AWS lambda or Azure functions</li> <li>Strong communicator and fluent in English with excellent written and verbal communication skills</li> </ul> Our Benefits We know that people do their best work when they&rsquo;re taken care of. So we make sure to offer great benefits. <ul> <li>Competitive Vacation Package</li> <li>Annual Financial Allowance for YOUR development</li> <li>Flexible Family Leave</li> <li>Clevertech Gives Back Program</li> <li>Clevertech U (Leadership Program, Habit Building, New Skills Training)</li> <li>Clevertech Swag</li> <li>Strong Clevertech Community</li> </ul> How We Work Why do people join Clevertech? To make an impact. To grow themselves. To be surrounded by developers who they can learn from. We are truly excited to be creating waves in an industry under transformation. True innovation comes from an exchange of knowledge across all of our teams. To put people on the path for success, we nurture a culture built on trust, collaboration, and personal growth. You will work in small feature-based cross-functional teams and be empowered to take ownership. We make a point of constantly evolving our experience and skills. We value diverse perspectives and fostering personal growth by challenging everyone to push beyond our comfort level and try something new. The result? We produce meaningful work Getting Hired We hire people from a variety of backgrounds who are respectful, collaborative, and introspective. Members of the tech team, for example, come from diverse backgrounds having worked as copy editors, graphic designers, and photographers prior to joining Clevertech. Our hiring process focuses not only on your skills but also on your professional and personal ambitions. We want to get to know you. We put a lot of thought into the interview process in order to get a holistic understanding of you while being mindful of your time. You will solve problems derived from the work we do on a daily basis followed by thoughtful discussions around potential fit. Whatever the outcome, we want you to have a great candidate experience. Want to learn more about Clevertech and the team? Check out&nbsp;<a href="http://clevertech.careers/" rel="nofollow">clevertech.careers</a>. <a href="http://bit.ly/RemoteCareerGrowth" rel="nofollow">Clevertech's Career Growth Video</a> <hr> Interested in exploring your future in this role and Clevertech? Set yourself up for success and take a look at our&nbsp;<a href="https://www.clevertech.biz/thoughts/interviewing-with-clevertech" rel="nofollow">Interview Process</a>&nbsp;before getting started! Want to learn more about Clevertech and the team? Check out<a href="http://clevertech.careers/" rel="nofollow"> clevertech.careers</a>. <a href="https://youtu.be/z5daft3oGjM" rel="nofollow">Clevertech Culture Video </a>

Sr. Python Data Engineer

Senior Data Engineer 100% Remote (U.S. based only) A Little Bit About StyleSeat: As a Senior Data Engineer at StyleSeat, you will have a rare opportunity to join a startup empowering small business owners across the country to be more successful doing what they love. Our mission is to help people look and feel their best. We are on the path to achieving this mission by being the go-to marketplace for consumers to discover, book, and pay for beauty and grooming services (hair stylists, colorists, nail artists, estheticians, barbers, etc). We are also the premier solution for all independent professionals in the industry to run and grow their business. We have powered over 120 million appointments booked and $10B in revenue for small businesses and are on the path to much more. In Your New Role: As a Senior Data Engineer you will join an impactful, multi-functional team of data scientists, data analysts, data engineers, and backend engineers who are dedicated to creating a data-driven culture.&nbsp; A team where everyone is active in defining the product and development process. As a result, you will know where your initiative and drive can best make a difference and be recognized.&nbsp; You'll know the internal and external customers with whom we are working, and the needs of each one.&nbsp; The Senior Data Engineer will utilize their experience and create appropriate solutions and tools to solve complex data engineering problems.&nbsp; StyleSeat is a rapidly scaling company making this the best environment to take on ownership of your role, as well as learn how to grow with a company. Our engineering team consists of developers from a wide array of backgrounds. Our team is a tight-knit, friendly group of engineers, who are dedicated to learning from each other. Team members regularly contribute to, and optimize our engineering best-practices and processes. Our team wants to make software engineering fun, easy, and fulfilling, so we've come up with a set of values that we apply to our software every day: Flexible, Consistent, Predictable, Efficient, and Pragmatic. What You&rsquo;ll Do: <ul> <li>Contribute to StyleSeat's Data &amp; Infrastructure Projects</li> <li>Demonstrate an interest in Big Data Technologies</li> <li>Develop and further develop Big Data processing pipelines for data sources containing structured and unstructured data</li> <li>Monitor and optimize key infrastructure components such as Databases, EC2 Clusters, Containers and other aspects of the stack</li> <li>Help promote best practices for Big Data development at StyleSeat</li> <li>Act as a bridge between the Data Engineering team and the wider Engineering organization</li> <li>Work closely with our Data Analytics and Data Science teams</li> <li>Work in an Agile manner with business users, data analysts and data scientists to understand and discover the potential business value of new and existing Data Sets and help put those discoveries into production</li> <li>Analyze requirements and architecture specifications to create detailed design</li> <li>Research areas of interest to the team and help facilitate solutions</li> </ul> What You Can Bring to the Table: You&rsquo;ve had experience at a bigger startup where you&rsquo;ve worked with big data architecture, and you were there while they scaled and can bring that experience to help us scale. You have a &ldquo;can-do&rdquo; attitude and you see your cross-functional work as equally important as the work within your immediate team. You&rsquo;re not afraid to challenge the status quo and suggest alternate architecture, and you actively encourage others to do so in a professional, tactful, and engaging manner. While you own everything you do, you also keep the bigger picture in mind <ul> <li>5+ years as a Backend Software Engineer or as a Data Engineer (Python Required)</li> <ul> <li>2+ years of experience with AWS Data Infrastructure, including RDS, RedShift &amp; S3</li> <li>2+ years building data pipelines in a high-ingestion environment with various forms of data infrastructure technologies</li> </ul> <li>Experience designing, developing, and owning ETL pipelines that deliver data with measurable quality under a pre-defined SLA</li> <li>Proficiency with Python, SQL and other scripting languages</li> <li>Experience using SQL daily to scale and optimize schemas, and performance-tune ETL pipelines</li> <li>An ability to identify and resolve pipeline issues, and discover opportunities for improvement in complex designs or coding schemes</li> <li>Experience monitoring existing metrics, analyzing data, and partnering with other internal teams to solve difficult problems creating a better customer experience&nbsp;</li> </ul> Nice-to-haves: <ul> <li>Experience with data streaming technologies e.g. Spark, Storm, Flink</li> <li>Experience with message queue systems e.g. Kafka, Kinesis</li> <li>Experience with any of the following message / file formats: Parquet, Avro, Protocol Buffer</li> <li>Experience with Redis, Cassandra, MongoDB or similar NoSQL databases</li> </ul>

spark-streaming

apache-kafka

Senior Data Engineer

HOMER has a newly created opportunity for a Data Engineer to join our growing team! This role will be based in Toronto, Ontario.&nbsp; Reporting into our Director of Technology, the Data Engineer will be responsible for improving and maintaining our data infrastructure and owning parts of it. You will focus on accuracy, reliability and timeliness of data that the whole company uses to generate insights, and deploying data science models that tackle sophisticated business problems. As you grow, you'll take on new responsibilities, from designing and defining our processes around data management to scaling our data pipeline. HOMER is the essential early learning program for kids 2-8. Powered by the HOMER Method, the most effective way for your child to learn&mdash; our expert-designed proprietary learning framework is research-backed and kid-tested to give your child the best start to their learning journey. Focused on both academic and personal skills, HOMER develops confident learners prepared for both school and life. We are a high-growth business with an amazing set of investors. We offer competitive compensation including equity and full benefits in a creative, flexible environment that invests in professional development. You will: <ul> <li>Collaborate effectively with our data scientists, analysts, engineers and other stakeholders to design and maintain data models&nbsp;</li> <li>Design scalable infrastructure to build, train, and deploy machine learning models, with an eye on efficiency</li> <li>Own efficacy and quality for data pipelines and ETL processes you build and maintain</li> <li>Develop, maintain and improve tools to enable team members to rapidly consume and understand data</li> <li>Implement and integrate solutions using Python, SQL, and other languages as necessary</li> <li>Improve and expand our product recommendation systems to be more powerful, helping children using our products to have greater success</li> <li>Help build and add new features to our in-house experimental tools to support A/B testing</li> </ul> Must Haves: <ul> <li>Demonstrable expertise&nbsp; in Python, SQL, Node, relational databases (e.g. PostgreSQL), non-relational databases (e.g. Couchbase or MongoDB), and column store (e.g. Vertica/Redshift)</li> <li>Experience building and maintaining&nbsp; data infrastructure (including batch and streaming ETL processes)</li> <li>Sound Computer Science fundamentals (Bachelor&rsquo;s degree in CS or related fields preferred)</li> <li>Strong interpersonal and communication skills</li> <li>At least 3 years of relevant work experience&nbsp;</li> </ul> Nice-to-Haves: <ul> <li>Knowledge of machine learning, statistics, and data visualization solutions (e.g. Looker)</li> <li>Knowledge of MapReduce and some distributed data processing methodologies and frameworks (e.g. Hadoop, Hive, Pig, Presto, Spark )</li> <li>Knowledge of deployment technologies in cloud hosted environments (e.g. AWS )</li> <li>Experience with Databricks</li> <li>Experience with mobile development in Objective-C, Swift or Javascript</li> </ul> We like people who: <ul> <li>Results oriented, hands-on and passionate about our industry (education) and our consumers (children, parents and educators)</li> <li>Collaborative, and thrive in startup environments</li> <li>Able and willing to learn new technologies and styles</li> </ul> What you&rsquo;ll get: <ul> <li>HOMER offers competitive compensation including equity and full benefits.</li> <li>Smart, passionate, and engaged co-workers.</li> <li>Excellent top-tier Medical/Dental/Vision benefits</li> <li>401k with 4% company match</li> <li>The chance to have a big impact, quickly</li> <li>The rare opportunity to make a dent in the universe. We&rsquo;re bringing a love of reading and learning to children globally!</li> </ul> HOMER is an equal opportunity employer and enthusiastically encourages people from a wide variety of backgrounds and experiences to apply. HOMER does not discriminate on the basis of race, color, religion, sex (including pregnancy), gender, national origin, citizenship, age, mental or physical disability, veteran status, marital status, sexual orientation or any other basis prohibited by law.

agile

Data Engineer III

The Data Acquisition (ETL) Developer will design, structure, and develop Informatica data warehouse program logic. The Extract Transform Load (ETL) Developer is responsible for the programs required to extract, transform, clean, and move data and metadata so they can be loaded into a data warehouse, data mart, or operational data store.&nbsp; In addition, he/she will lead the work of other ETL Developers and work closely with Data Analyst and Data Modelers to develop enterprise data integration solutions that promote re-usability and standardization. Essential Job Functions: &bull;&nbsp;&nbsp; &nbsp;Design, code, and test major features, as well as work jointly with other team members to provide complex software enhancements for databases &bull;&nbsp;&nbsp; &nbsp;Collaborate with functional team and other team leads to create integration solutions &bull;&nbsp;&nbsp; &nbsp;Apply generally accepted programming standards and techniques to assure efficient program logic and data manipulation. &bull;&nbsp;&nbsp; &nbsp;Lead design and review meetings with all appropriate parties &bull;&nbsp;&nbsp; &nbsp;Ensure design, structure, and content meet performance guidelines; assist with test planning and testing.. &bull;&nbsp;&nbsp; &nbsp;Develop detailed documentation including functional and technical design documents, test cases, support documentation, migration and installation steps, release notes, mapping documents etc. &bull;&nbsp;&nbsp; &nbsp;Provide high-level analysis and design reviews to solve conceptual problems and avoid duplication of efforts within the development group. &bull;&nbsp;&nbsp; &nbsp;Analyze the performance of current code as well as new code to ensure reasonable performance is met. &bull;&nbsp;&nbsp; &nbsp;Communicate with all levels of staff with regard to technical concepts and design in order to create the best product which meets all of the customer requirements. &bull;&nbsp;&nbsp; &nbsp;Communicate with project teams on problem resolution, design issues, and technical implementations. Skills/Requirements/knowledge REQUIRED: &nbsp; &bull;&nbsp;&nbsp; &nbsp;5+ years of experience as an ETL Developer using Informatica Enterprise Integration Tools (within an EDW): o&nbsp;&nbsp; &nbsp;PowerCenter 9.x o&nbsp;&nbsp; &nbsp;PowerExchange 9.x &bull;&nbsp;&nbsp; &nbsp;Experience leading and developing medium to large scale Operational and Decision Support based Data Integration projects including Real-Time and Webservice based initiatives &bull;&nbsp;&nbsp; &nbsp;Extensive experience with SQL with relational databases (SQL Server, DB2) &bull;&nbsp;&nbsp; &nbsp;Experience with relational and dimensional data modeling &bull;&nbsp;&nbsp; &nbsp;Experience building and operating a data warehouse &bull;&nbsp;&nbsp; &nbsp;Knowledge of Data Profiling and Data Quality concepts and techniques &nbsp; &bull;&nbsp;&nbsp; &nbsp;Critical thinker with excellent analytical and problem solving skills &bull;&nbsp;&nbsp; &nbsp;Advanced knowledge of industry standards/best practices surrounding all aspects of the Software Development Life Cycle DESIRED: &nbsp; &bull;&nbsp;&nbsp; &nbsp;Bachelor&rsquo;s Degree &bull;&nbsp;&nbsp; &nbsp;Exposure to data modeling tools like Visio, Embarcadero, Erwin &bull;&nbsp;&nbsp; &nbsp;Master Data Management experience and Metadata Management experience &bull;&nbsp;&nbsp; &nbsp;Experience with Microstrategy

design

informatica

microstrategy

informatica-powercenter

ETL Developer

Market America/Shop.com, a Global Product Brokerage and Internet Marketing company that specializes in One-to-One Marketing, is seeking an experienced SQL Database Developer in our Shop.com IT department. Position Summary The SQL database developer has expertise in SQL coding and data modeling, reporting and analytics, and has worked with Microsoft SQL server and Microsoft BI technologies.&nbsp; Designs and develops data processing, data models and reports to support our SHOP.COM site development team.&nbsp; Will also be responsible for organizing and improving workflow for our SSRS Report Server. Will work with Business users such as marketing, product managers, and managers of third party relationships. Essential Duties and Responsibilities <ul> <li>Build an understanding of the business and how it maps to databases, then develop processes, reports or tools to extract the data needed.</li> <li>Use MS SQL/SSIS/SSRS and Excel technologies to maintain and improve business reporting and analytics.</li> <li>Data Warehouse Analysis, Design and Development. Development of new and maintenance of existing SSIS packages and processes.</li> <li>Development and maintenance of T-SQL Queries and stored procedures.</li> <li>Work with other SQL developers to develop and extend data warehouse modeling to provide flexible and efficient access to information.</li> <li>Lead projects to implement ETL workflows.</li> <li>Work with business users and business analysts to identify information needs, and design effective reporting and information delivery.</li> <li>Build, testing and deployment of MSBI components across multiple environments.</li> <li>Performance tuning of T-SQL Queries, stored procedures, SSIS packages and ETL services.</li> <li>Management and monitoring of SSIS/ETL environments.</li> <li>Development and implementation of process, procedures and SOPs for MSBI components.</li> <li>Complies with company policies and procedures.</li> <li>Performs other duties as needed.</li> </ul> Education and Experience <ul> <li>A bachelor's degree in science, technology, engineering, business or a similar field is required OR equivalent combination of education and experience.</li> <li>5+ years of direct hands on ETL including database, application design, transformations and process flows.</li> <li>Demonstrated SQL development experience working well with business users having varying levels of technical capability</li> <li>Experience with querying large data sets and troubleshooting performance issues</li> </ul> Skills <ul> <li>Strong understanding of data warehousing and business intelligence architecture.</li> <li>Understanding of Microsoft SQL Server database development and administration tasks</li> <li>Strong understanding of ETL design and implementation.</li> <li>Strong T-SQL development skills, including development of automation scripts.</li> <li>Experience with Performance Tuning, including performance problem identification,</li> <li>Excellent oral and written communication and collaboration skills required, to effectively work with a variety of business users and software developers.</li> <li>Ability to act proactively and to apply creative problem-solving skills</li> <li>Motivated learner with a passion for technology</li> <li>Experience with Excel, Power BI, Tableau or another BI tools a plus</li> <li>Experience with big data techniques a plus</li> <li>Excellent organizational skills with attention to detail</li> <li>Ability to meet deadlines, prioritize and multi-task effectively in a fast-paced work environment</li> <li>Ability to work independently or as a member of a team to meet the stated objectives of Market America and marketamerica.com</li> <li>Experience with development and documentation of technical specs, diagrams, and best practices.</li> <li>Knowledge of cloud based (Azure and/or AWS) BI implementations.</li> </ul> Market America offers competitive salary and generous benefits, including health, dental, vision, life, short and long-term disability insurance, a 401(k) retirement plan with company match, and an on-site health clinic. Qualified candidates should apply online. This position will be based from our Greensboro NC location but performed remotely. We are not currently able to sponsor for this position. Market America is proud to be an equal opportunity employer. ABOUT MARKET AMERICA, INC. &amp; <a href="http://shop.com/" rel="nofollow">SHOP.COM</a> Market America | SHOP.COM is changing the way people shop and changing the economic paradigm so anyone can become financially independent by creating their own economy and converting their spending into earning with the Shopping Annuity&reg;. ABOUT MARKET AMERICA, INC. &amp; SHOP.COM Currently in its 27th year, Market America, Inc. is a global product brokerage and Internet marketing company that specializes in one-to-one marketing and is the creator of The Shopping Annuity.&nbsp; Its mission is to provide a robust business system for entrepreneurs, while providing consumers a better way to shop.&nbsp; Headquartered in Greensboro, NC, the company was founded in 1992 by Chairman and CEO JR Ridinger and has generated over $8.5 billion in accumulated sales.&nbsp; Market America employs approximately 1,000 people globally with operations in the United States, Canada, the United Kingdom, Taiwan, Hong Kong, Singapore, Australia and Malaysia. Through the company&rsquo;s primary shopping website, SHOP.COM, consumers have access to approximately 60 million products, including Market America exclusive brands and thousands of top retail brands. Market America&rsquo;s revolutionary Shopping Annuity program, which helps shoppers convert their existing everyday spending into earning, is an extraordinary and financially meaningful benefit of the business. Internet Retailer has ranked SHOP.COM #65 in the 2018 Internet Retailer Top 1000, the #36 largest global online marketplace in the 2019 Internet Retailer Top 100 Online Marketplaces Database, #96 in the Internet Retailer Asia 500 and the 18th fastest growing Internet Mobile Retailer. The company is also a two-time winner of the Better Business Bureau&rsquo;s Torch Award for Marketplace Ethics, was ranked 8th in the 2018 Grant Thornton North Carolina Top 100&reg; (NC100) and received 2018&rsquo;s Triad Business Journal&rsquo;s &ldquo;Fast 50&rdquo; award as one of the top privately-held companies for sustained growth, driving the area&rsquo;s economy. By combining Market America&rsquo;s entrepreneurial business model with SHOP.COM&rsquo;s powerful comparison shopping engine, Cashback program, Hot Deals, SHOPBuddy&trade;, Express Pay check out, social shopping integration and countless other features, the company has become the ultimate online shopping destination. For more information, please visit <a href="https://www.lumieredevie.com" rel="nofollow">https://www.lumieredevie.com</a>, <a href="http://www.marketamerica.com" rel="nofollow">http://www.marketamerica.com</a> or <a href="http://www.SHOP.COM" rel="nofollow">http://www.SHOP.COM</a>

tsql

ssis

ssrs

SQL Database Developer

This is a full-time fully remote position for Latin American based applicants within +/- 2 hours of Eastern Standard Timezones(NYC). Applicants must have strong written and oral communication in English. &mdash; Solutions Architect Blue Orange Digital is looking for a Solutions Architect to join our talented multi-disciplinary team. Blue Orange is looking for an experienced Solutions Architect with significant experience in enterprise Data Lake &amp; Data Warehouse initiatives. We build modern data analytics platforms for our clients that incorporate advanced analytics and machine learning to solve business problems. Blue Orange Digital works across multiple industries, this role provides an exciting set of experiences across a wide range of domains. This person will work directly with our client's leadership to help define the architecture of the future enterprise data platform. They will work closely with stakeholders and team members to determine the needs of the platform and design solutions that can allow the company to use data more efficiently and build trust in it. Responsibilities <ul> <li>Analyze Client Needs and Requirements in order to design robust solutions</li> <li>Design and thoroughly document Software and Data Architectures for the client needs</li> <li>Work with stakeholders across the client's teams to understand their needs and make recommendations.</li> <li>Communicate solutions effectively with clients and team members</li> <li>Monitor progress and adjust architecture/decisions as needed</li> <li>Establish best practices and bake them into solution designs</li> <li>Consider security, performance, quality</li> <li>Create POCs to kickstart the development for the team.</li> <li>Evaluate new technologies</li> </ul> Qualifications <ul> <li>Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience.</li> <li>8+ years of enterprise IT experience across data engineering, software engineering, DevOps or architecture roles.</li> <li>Excellent verbal and written English communication.</li> <li>5+ years experience of Cloud computing experience.</li> <li>5+ years experience implementing Data Lake &amp; Data Warehouse platforms.</li> <li>Experience with AWS Glue, AWS Redshift</li> <li>In-depth working knowledge in Big Data &amp; Analytics</li> </ul> Preferred Qualifications <ul> <li>AWS certification, at the associate level (Solutions Architect or Developer), or specialty (Big Data) a strong advantage.</li> <li>Demonstrated leadership in the fields of big data, data warehousing or data science.</li> <li>Understanding of Apache Hadoop and the Hadoop ecosystem. Experience with one or more relevant tools (Sqoop, Flume, Kafka, Oozie, Hue, Zookeeper, HCatalog, Solr, Avro).</li> <li>Experience with streaming data systems and IOT applications.</li> <li>Hands-on experience designing enterprise data models.</li> </ul> Company Introduction "Top 10 AI development and consulting Agencies in NYC" - Clutch As seen in: IBM thinkLeaders, Dell Innovators, YahooFinance, Global Banking &amp; Finance Review Magazine, IoT Council of Europe, AiBusiness, Data-Driven Investor, DataFloq, Supply Chain Matters, Machine Learning Times. <a href="https://blue-orange-digital.breezy.hr/" rel="nofollow">See all our Open Positions</a> Founded by freelance engineers, Blue Orange Digital aims to bring an engineering-first approach to the development agency model. We aim to work on projects that use the latest and greatest technologies. We care about the products we build and only work with clients who understand that good applications come from happy engineers. We are an entirely distributed team with members all across the US and Latin America. *If you're seeing this on&nbsp;a scraped job board go to our website: BlueOrange.Digital &gt;Careers&gt;Apply Now&gt; breezy.hr and QUICK APPLY(3 min) with your Linkedin profile, Indeed profile, or attach an English resume. Done.

architecture

hadoop

Solution Architect

As part of the Avail Data Engineering team, you will be working to manage our ever-growing collection of vehicle sharing and usage data. We support our business analytics and marketing teams by performing data integration and ETL between an increasingly diverse set of data sources and our data warehouse. We will also build big-data applications leveraging techniques from operations research and machine learning to directly enrich, personalize and optimize the Avail car-sharing product. This is a green field opportunity to contribute to the design and implementation of a flexible, scalable data framework for an exciting new sector of the sharing economy.&nbsp; This position can be based in either of two Avail HQ offices at San Francisco or Chicago, or fully remote with regular travel to SF HQ. Key Responsibilities <ul> <li>Design and implement scalable data workflows and pipelines, and integrate diverse data sources and sinks</li> <li>Design appropriate database schemas and optimize database deployment architectures for analytics query loads</li> <li>Implement data transforms and organization for various data stores (data lakes and warehouses)</li> <li>Design and implement new platform architectures for building and serving machine learning models</li> <li>Work with the platform operations team to monitor and maintain live production systems</li> <li>Provide tooling and automation for infrastructure, continuous testing, and continuous deploy of data systems&nbsp;</li> </ul> Job Qualifications <ul> <li>Mid-to-senior&nbsp;levels considered. Candidates must demonstrate experience-appropriate track records of successful technical execution of large-scale data projects.</li> <li>Software Engineering &ndash; Experience in software engineering and SDLC (our stack may include Python,&nbsp;Java and Scala). Must consider code readability, reuse, and extensibility a priority when developing solutions.</li> <li>Big Data Engineering &ndash; Experience in building scalable data pipelines involving machine learning, optimization or prediction</li> <li>Big Data Devops &ndash; Experience in performing operations and automation of various big-data ecosystems in production environments on AWS or a related cloud service</li> <li>Ability to thrive in a fast paced, cross regional, diverse, and dynamic work environment</li> </ul> Nice to have: <ul> <li>Experience with AWS data stack &ndash; Redshift, Athena, EMR, DynamoDB, Glue, S3</li> <li>Experience with establishing well-organized data lakes</li> <li>Experience setting up and optimizing data warehouses</li> <li>Background in data modeling and performance tuning in relational and no-SQL databases</li> <li>Experience with data practices (security, data management and governance)</li> <li>Experience in operations research, machine learning or optimization</li> </ul> Avail is a subsidiary of Allstate. About working at Allstate: Allstate&nbsp;generally&nbsp;does not sponsor&nbsp;individuals for&nbsp;employment-based&nbsp;visas&nbsp;for this position. The candidate(s) offered this position will be required to submit to a background investigation, which includes a drug screen. Good Work. Good Life. Good Hands&reg;. As a Fortune 100 company and industry leader, we provide a competitive salary &ndash; but that&rsquo;s just the beginning. Our Total Rewards package also offers benefits like tuition assistance, medical and dental insurance, as well as a robust pension and 401(k). Plus, you&rsquo;ll have access to a wide variety of programs to help you balance your work and personal life &mdash; including a generous paid time off policy.

airflow

apache-spark

amazon-redshift

terraform

Company:&nbsp;Community.com Type of role: Full time, Fully Remote&nbsp;(longterm) anywhere in the US or onsite in Santa Monica (post Covid) Comp: $150k - $190k (highly dependent on experience + work location) + Attractive Series A Equity + various other benefits Role title:&nbsp;Senior Data Engineer About the role and your impact: Community.com provides a messaging platform for leaders, influencers, and celebrities (Barack Obama launched his number this week) - anyone with an audience - to interact with their supporters at scale via text message. As a Senior Data Engineer you will be a critical addition to our data team. You are someone with demonstrated experience building and scaling a data delivery platform that has enabled a data-driven business to grow and improve. We have lots of data, and a clear vision for what we need to achieve with our second generation platform, but are looking for the person with both the experience and skills to take us to the next level and put our vision into production. You will be working with a distributed, remote-first team that spans North America and Europe. Your day will be spent building, programming, and scaling our cutting edge data platform using technologies like Snowflake, Spark (Databricks), Apache Airflow, Postgres, Data Build Tool, and Python. In addition to building systems and writing software, you will collaborate with leadership, product managers, and growth teams to deliver actionable business and product insights. What You&rsquo;ll Do: <ul> <li>Develop and maintain data systems that scale with increasing data volume and complexity</li> <li>Collaborate with key stakeholders to design data models that feed business intelligence tools, increasing data accessibility and foster data-driven decisions across the entire organization</li> <li>Implement systems and processes to monitor data quality, ensuring production data is always available and accurate</li> <li>Write quality ELT code with an eye towards performance and maintainability</li> <li>Drive architectural plans and implementation for future data storage, ETL, reporting, and analytic solutions.</li> </ul> What You&rsquo;ll Ideally Bring: <ul> <li>Extensive Python experience&nbsp;</li> <li>Strong SQL skills and an solid understanding of relational databases</li> <li>Previous experience in a fast-paced startup environment (big plus)</li> <li>Experience with cloud warehousing platforms (Snowflake, BigQuery, etc)</li> <li>Experience with airflow, DBT, and/or similar tools</li> </ul>

databricks

Fully Remote Senior Data Engineer

We are:News UK is a company full of talented, dedicated and creative people. We are an ambitious and ever-growing organisation with a passion for storytelling, capturing moments, meaning and magic to make sense of the world. Our newspapers reach more than 30 million people each week and include The Sun, The Times and The Sunday Times. News UK is also home to Wireless, a leading UK and Irish media company boasting independent local and national radio stations including talkSPORT, VirginRadio, talkRADIO and TimesRadio. We are Technology:&nbsp;a department that has people and product at its heart. Lead by Christina Scott&nbsp;CTO of the Year (Tech Leaders) 2017, who comes with many years experience transforming technology in media companies. Christina has set out our vision of &lsquo;passionate and trusted experts creating industry-leading solutions through attracting and developing the best talent&rsquo;.&nbsp;&nbsp; Your team;&nbsp;Data Platforms,&nbsp;an award-winning programme (Drum Online Media Awards 2018, British Media Awards 2018) that comprises a number of agile, cross-functional teams between London and Bangalore. We own data platforms, and enable teams to build front-end products and create predictive models for News UK. We focus on the capture, management and utilisation of customer, clickstream and content data in our warehouses, in order to drive growth and increase revenue for our users. Our users include the newsroom editors, marketing, analytics, advertising and product teams associated with our world-leading digital and print publications.&nbsp;Our data architecture includes customer and digital data built in our Unified Data Platform in Google BigQuery.&nbsp; Your role:&nbsp;You will&nbsp;own the creation, maintenance and delivery of the business intelligence layer of our data platforms, to ensure business can access data from the data warehouse easily and in a consistent and abstracted manner in order to drive value from our data. Day to day you will:&nbsp; <ul> <li>Be primarily responsible for the technical delivery of business intelligence and data warehousing projects and initiatives for the business units at NewsUK along with a team of on-shore and off-shore Data engineers.</li> <li>&nbsp;Lead a team of data specialists (e.g. architect, business analysts, data engineers) to own and maintain the data warehouse and business intelligence layers for both batch and real-time data consumption across business units like Campaigns, Analytics, Data Science etc.</li> <li>Be the primary technical interface between the team and external stakeholders across the business (Campaigns, Analytics, Ads, etc.) and internal stakeholders in Data Technology (Data products, Data science etc.)</li> <li>Manage and own the end to end workflow and process from user request to design, implementation, work allocation, technical outputs and operations. You will be working closely with an Agile scrum master/delivery manager to ensure process and workflow are clearly understood and followed and also to align with expectations on delivery dates.</li> <li>Be responsible for BI/DW technical solution of new requirements and platform improvements. The Principal Data Engineer will need to understand the impact of introducing new requirements into current platforms, and define the best technical solution&nbsp;</li> <li>Responsible for technical implementation based on best BI/DW best practices</li> <li>Responsible for the daily operation of the DW platforms, implementation of Operations KPIs for continuous improvement, definition of SLAs, and manage operations communications with business users.</li> </ul> What we&rsquo;re looking for from you: <ul> <li>You will have strong consulting skills, working with a diverse and exciting range of business stakeholders, and translating business requirements into technical requirements for data engine</li> <li>&nbsp;You will be able to interpret and validate business needs and drive quick agile prototypes to establish feasibility and translate outputs into business language for stakeholders</li> <li>Be able to build relationships and interact with senior staff and adapting your style to different audiences and be a self-starter and goal-oriented with great attention to detail and adaptable to a fast-paced business environment</li> <li>You have a strong delivery focused mindset with ability to manage multiple streams of requests and apply elements of pragmatism, urgency, business value and standardisation to help prioritise these requests for the business and the data engineering team.</li> <li>You will be an expert in your field with experience of data modelling for BI implementations needed for a variety of traditional and cloud based BI and reporting tools (SSAS Cubes, Qlikview, Qliksense, Tableau, Chartio, Looker etc.)</li> <li>You will have a knowledge and strong interest to work with modern cloud based data architectures and platforms built on Google cloud (GCP and BigQuery)&nbsp; or equivalent cloud based platforms.&nbsp;</li> </ul> <a href="https://medium.com/news-uk-technology" rel="nofollow">Check out our latest blogs</a>&nbsp; <a href="https://medium.com/news-uk-technology/designing-better-digital-metrics-in-the-times-and-the-sunday-times-newsrooms-ad50d912e8ae" rel="nofollow">Hear about how we are using data to make better decisions for our newsrooms </a> What's in it for you?We are a diverse and dynamic team, with opportunities to learn and develop your skills in a supportive environment. We have an amazing office, a flexible working pattern and a great team culture. We&rsquo;ll help you deliver your best work and grow you with career and personal development through training, conferences and courses. NewsUK Benefits We take pride in looking after our amazing talent at News UK. Alongside pay, we offer: <ul> <li>A generous pension scheme with employer contributions of up to 5%;</li> <li>A comprehensive private medical scheme covering pre-existing conditions;</li> <li>Maternity leave of up to 18 weeks full basic salary and paternity leave of up 2 weeks full basic salary;</li> <li>Discounted rates for Fitness First gym membership for employees and immediate family;</li> <li>A range of different flexible working options, which can be requested by employees;</li> <li>Interest free commuter loan of up to &pound;10,000 tax free</li> <li>&lsquo;Bikes For Work&rsquo; scheme to save income tax and national insurance;</li> <li>Up to four Volunteering Days per year for employees to use on charities of choice;</li> <li>Health and wellbeing benefits including on-site physio/massage, counselling, legal advice, and others.</li> </ul> Equal opportunities: The Company is an equal opportunities employer and wholeheartedly supports the principle of equal opportunities for all its employees and for all applicants for employment. It opposes all forms of discrimination in the workplace. We are a diverse team so want to maximise every individual&rsquo;s potential to create a productive environment where everyone feels valued, and where talents are fully recognised and utilised. This means affording equal access to any employment opportunities within the Company according to your ability, without prejudice or discrimination by reason of race, colour, nationality, ethnic or national origin, religion, belief, gender, sexual orientation, gender reassignment, marital status, disability or age.

google-cloud-platform

data-warehouse

datamart

Principal Data Engineer

Job Title:&nbsp;Software Engineer II&nbsp; Location: Remote or any Comscore location About this Role: Comscore is a leading cross platform audience measurement company. We measure what matters to make audiences and advertising more valuable. We collect and process billions of events each day, have 10s of petabytes online and each month our processes read nearly an exabyte. We use this capability to provide our clients with unlocked insights in their data. We are looking for a Software Engineer to join our team with a solid understanding of Computer Science fundamentals. This position plays a fundamental role in designing and maintaining big data web &amp; engineering solutions capable of running efficiently and robustly at petabyte scale.&nbsp; What You&rsquo;ll Do: <ul> <li>Develop forward looking solutions that can creatively utilize data assets while being fault tolerant</li> <li>Leveraging best practices in extensible and reusable components to allow rapid development</li> <li>Collaborate with DevOps, Release Management, Research and Operations teams</li> <li>Coordinate with external stakeholders to deliver on product requirements</li> </ul> What You'll Need: <ul> <li>We are looking for an individual who can take the lead in projects providing accurate estimates and collaborating with teammates and stakeholders as necessary to solve problems</li> <li>Ability to understand &amp; improve enterprise software applications while factoring in overall design goals</li> <li>Knack for finding the problem at a high level and drilling down to the details to solve</li> <li>Bachelor&rsquo;s degree in computer science or a related field</li> <li>2+ years of experience in developing applications in professional environment</li> <li>2+ years developing software using Java in Linux environment, Hadoop, Pig or Spark expertise. Scala is a plus</li> <li>Comfortable with a variety of java build systems including ant and maven</li> <li>Basic SQL experience required</li> <li>Data visualization and data wrangling proficiency desired</li> <li>Developing with a machine learning tech stack is a plus</li> <li>Java web development using embedded Jetty and Play framework is a plus</li> </ul> About Comscore: At Comscore, we&rsquo;re pioneering the future of cross-platform media measurement, arming organizations with the insights they need to make decisions with confidence. Central to this aim are our people who work together to simplify the complex on behalf of our clients &amp; partners. Though our roles and skills are varied, we&rsquo;re united by our commitment to five underlying values: Integrity, Velocity, Accountability, Teamwork, and Servant Leadership. If you&rsquo;re motivated by big challenges and interested in helping some of the largest and most important media properties and brands navigate the future of media, we&rsquo;d love to hear from you. Comscore (NASDAQ: SCOR) is a trusted partner for planning, transacting and evaluating media across platforms. With a data footprint that combines digital, linear TV, over-the-top and theatrical viewership intelligence with advanced audience insights, Comscore allows media buyers and sellers to quantify their multiscreen behavior and make business decisions with confidence. A proven leader in measuring digital and set-top box audiences and advertising at scale, Comscore is the industry&rsquo;s emerging, third-party source for reliable and comprehensive cross-platform measurement. To learn more about Comscore, please visit Comscore.com. EEO Statement: We are an equal employment opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, national origin, sex, disability status, sexual orientation, gender identity, age, protected veteran status or any other characteristic protected by law. To comply with federal law, Comscore participates in E-Verify. Successful candidates must pass the E-Verify process after hire.

java

linux

web-services

Software Engineer II

We are looking for an experienced, senior, BI Engineer, who is excited to work on one of our many client projects - both greenfield (new) projects as well as legacy (support) projects in that technology stack. This is a remote position, 40 hours a week. Skills &amp; Requirements <ul> <li>5+ years of experience related to data analysis and modeling complex raw data</li> <li>Advanced relational databases and data modeling skills</li> <li>Very strong experience in SQL and dimensional modeling, extracting large sets of data, and design of ETL flows; proficiency in both Airflow and DBT is a big plus</li> <li>Hands-on experience working with data warehouse technologies such as Snowflake, Redshift, Salesforce</li> <li>Strong familiarity with version control systems such as Github</li> <li>Proficiency in modern analytics tools such as Looker, Tableau</li> <li>Experience with statistical analysis and predictive analytics skills such as Python, R</li> <li>Ability to understand data models of core business systems</li> <li>Strong data visualization skills and understanding of principles of visual design such as Edward Tufte, Stephen Few is a plus</li> <li>Excellent written and verbal communication and interpersonal skills, ability to communicate complex technical topics cross-functionally and effectively collaborate with technical and business partners within Finance, Business Operations, and Engineering</li> </ul>

BI Engineer

Blue Orange Digital is looking for a Data Engineer to join our talented multi-disciplinary team. We build data analytics platforms for our clients that incorporate machine learning to solve business problems. Blue Orange Digital works across multiple industries, this role provides an exciting set of experiences across a wide range of domains. Your primary focus will be the architecting and developing systems that include data ingestion, data processing, algorithm development. Major technologies involved include AWS (Lambda, Glue, CloudFormation, EMR), Python 3, Spark, Pandas. Blue Orange engineers take end-to-end ownership of their code and platforms, so the ideal candidate for this position has a mixture of experience in Cloud Engineering and Data Engineering. Core Responsibilities &amp; Skills <ul> <li>Architecting, building and maintaining modern, scalable data architectures on AWS</li> <li>Building resilient production ETL pipelines using workflow orchestration tools such as Airflow, Prefect, AWS Step Functions</li> <li>Deploying and managing infrastructure with automation to support data pipelines.&nbsp;</li> <li>Deploying and scaling machine learning models in production.&nbsp;</li> <li>Data exploration, analysis, and reporting with an eye towards developing a narrative using Notebooks.</li> </ul> Qualifications <ul> <li>BA/BS degree in Computer Science or a related technical field, or equivalent practical experience.</li> <li>Advanced experience in Python with an excellent understanding of computer science fundamentals, complex data structure, data processing, data quality, data lifecycle, and algorithms.</li> <li>Experience in Amazon AWS, DevOps and Automation (CloudFormation)</li> <li>AWS certification, or progress toward, at the associate level (Solutions Architect or Developer), or specialty (Big Data) a strong advantage.</li> <li>Enjoys collaborating with other engineers on architecture and sharing designs with the team&nbsp;</li> <li>Excellent verbal and written English communication.</li> <li>Interacts with others using sound judgment, good humor, and consistent fairness in a fast-paced environment</li> </ul>

Data Engineer

We are looking for a talented&nbsp;Data Architect&nbsp;to play a critical role in implementing our strategy as the leader in data collection, management, and assessment of supply chain data. In this key role, you will work with stakeholders across the organization to understand our evolving business needs. You will also apply your leadership and deep expertise in SaaS data management working with other technical leaders and developers to drive the design and implementation of a data architecture that solves immediate business challenges while aligning with future innovation and growth.&nbsp; You'll be working on: <ul> <li>Working with stakeholders across the organization to understand the needs of an evolving, scalable and secure data architecture&nbsp;</li> <li>Provide leadership to the development team, applying your thorough understanding of business needs as well your deep technical knowledge and experience, to drive design and implementation decisions that align with the overall data architecture vision</li> <li>Ensure that the data architecture and its implementation are optimized for scale, reliability, performance and security while facilitating velocity and consistency across development teams</li> <li>Help foster a culture of collaboration and innovation, where difficult data challenges are tackled eagerly with a focus on measurable outcomes</li> <li>Document and champion data architecture design goals, best practices and decisions, as well as existing and new data interfaces, data flows and data models&nbsp;</li> <li>Provide support and mentoring to software developers in all aspects of logical database design, creating and tuning queries, and other related activities;</li> <li>Analyze and measure existing system&rsquo;s design, performance, and/or implementation issues and work on short term plans, proofs of concepts, actual implementation to help resolve issues</li> <li>Participate in SQL development reviews (ad hoc scripts, stored procedure, triggers etc.)</li> <li>Provide support and assistance to load testing activities and testing result reviews</li> </ul> Join us if you: <ul> <li>Bachelor's degree required in computer/software engineering or related technical discipline.</li> <li>At least 7 years of experience in senior database development roles</li> <li>Proven track record of designing data solutions for large, Enterprise-level SaaS applications</li> <li>Excellent communication skills with a keen ability to convey complex ideas and drive deep understanding among various audiences</li> <li>Extensive experience in data architecture, including physical and logical database design</li> <li>Expert knowledge of MS SQL Server or other RDBMS and data integration tools</li> <li>Several years of experience mining structured and unstructured data, as well as data integration</li> <li>Highly proficient with, and the ability to stay current on all aspects of designing and developing data management solutions, including database batch processing; data modeling (including indexes, partitions), and database performance tuning (SQL Server, Oracle or DB2)</li> <li>Experienced with data warehouse schema modeling and creating ETL packages, as well as providing support for BI Solutions (Tableau, Microsoft Power BI, etc.)</li> <li>Strong Agile development experience</li> <li>Deep understanding of Cloud infrastructure and related technologies</li> <li>Are a true team player, and see collaboration and feedback as a means to innovate and accelerate greatness</li> </ul> What&rsquo;s in it for you? At Assent, we are an ambitious, fast-paced business which means there is never a dull moment. We strive to give back to our employees as much as they give to us. In addition to a competitive salary, you can expect to: <ul> <li>Love what you do as part of a supportive team that really wants you to succeed.</li> <li>Accelerate greatness in a position and company with high learning and growth potential.</li> <li>Choose how you work best in a flexible work environment.</li> <li>Spend your days making a difference, not just working for a living. We help our customers all over the world by providing a real understanding of their supply chain data so they can protect their brands, remove market access barriers, and reduce operational and financial risk.</li> </ul> At Assent, your contribution has purpose. Our team challenges each other to be better every day; we dig deep to build a culture of innovation and high performance for our people and our clients. All applicants will need to fulfill the requirements necessary to obtain a background check. Reasonable Accommodations Statement: To perform this job successfully, an individual must be able to perform the aforementioned duties and responsibilities satisfactorily. Reasonable accommodations may be made to enable qualified individuals with disabilities to perform these essential functions.

saas

sql-server

database-design

Data Architect

DataLink Software is seeking a highly qualified, experience ETL developer. The right candidate for this position is someone who enjoys challenging work in a fast-paced environment and solving complex business problems with data and analytics enabling our customers in their pursuit of better healthcare outcomes for their members. Essential Functions <ul> <li>Design, develop and implement ETL solutions for ingesting, cleansing, business rules execution and pushing customer data into DataLink&rsquo;s systems.</li> <li>Significant participation in analysis, interpretation, and translation of complex health plan data, issues, trends and relationships to provide our customers detailed insights into their data</li> <li>Analyze and interpret complex data on source and target systems, identify the gaps, and provide solutions</li> <li>Ability to write complex SQL queries</li> <li>Optimizes SSIS package execution and SQL execution to minimize load times.</li> <li>Ensures data integrity throughout the ETL process and appropriately handle errors</li> <li>Work closely with Scrum team members using Agile processes to iteratively develop and improve ETL pipelines.</li> <li>Proactively provide feedback and process improvement recommendations to the team and management</li> <li>Other duties as assigned</li> </ul> &nbsp;Qualifications <ul> <li>Overall 5+ years of experience designing and developing ETL processes</li> <li>3+ years of experience with SSIS, SSRS, SQL Server and T-SQL</li> <li>Data analysis, data presentation, spread sheet and database capabilities</li> <li>3+ years of experience automating ETL pipelines with a heavy emphasis on quality, validation and tracking</li> <li>Experience with SAS or other statistical applications</li> <li>Experience with SSAS, Tabular Models and/or Star Schemas</li> <li>Experience with Healthcare data</li> <li>Experience with NoSQL Database such as Hadoop and Mongo</li> <li>Must be eligible to work within the US, we are unable to offer Sponsorship at this time</li> </ul>

reporting-services

Overview The centralized Data and Analytics team at ReCharge delivers critical analytic capabilities and insights that drive definition and implementation of our business strategies. The Data Engineer opportunity is ideal for someone who is passionate about wrangling and building pipelines for multiple large sets of data from disparate sources to provide end to end data solutions, empowering the organization to meet key business objectives. As a Senior Data Engineer, you will own and architect Recharge&rsquo;s data landscape. You will combine product usage, behavioral, transactional, business systems, and third-party data into the analytics pipeline. You will work closely with our analytics and engineering teams to implement solutions to answer complex questions and drive business decisions. What You'll Do <ul> <li>Live by and champion our values: #day-one, #ownership, #empathy, humility.</li> <li>Hands-on leadership, influence, and development of all things data services.</li> <li>Develop modern data architectural approaches for business intelligence reporting and analytics, including that for machine learning models and data science, ensuring effectiveness, scalability, and reliability.</li> <li>Design, develop, implement, and optimize existing ETL processes that merge data from disparate sources for consumption by data analysts and scientists, business owners, and decisions makers.</li> <li>Complete current evaluation of new ETL software options, propose recommendations, and implement the solution.</li> <li>Facilitate data transformation, normalization, cleansing, aggregation, workflow management, and business rule application.</li> <li>Detect data quality issues, identify their root causes, implement fixes, and design data audits to capture issues.</li> <li>Distill technical requirements into the product development and operational process via continuous collaboration with product, engineering, and analytics team members.</li> <li>Influence and communicate with all levels of stakeholders including analysts, developers, business users, and executives.</li> <li>Use analytics to influence product development, surfacing data around product usage and customer behavior.</li> <li>ETL tool evaluation and implementation to prepare for scaling and efficiency.</li> </ul> What You'll Bring <ul> <li>Typically, 6+ years experience in a data engineering related role (Data Warehouse Developer, ETL Developer, Business Intelligence Analytics, Software Engineer) with a track record of manipulating, processing and extracting value from datasets</li> <li>Experience working with&nbsp; a variety of ETL platforms (Matillion {preferred}, CloverETL, FiveTran, Stitch, DBT, Spark, AWS Glue, DataFlow)</li> <li>3+ years of hands-on experience designing and building ETL pipelines for&nbsp; ingesting, transforming and delivery of large amounts of data, from multiple sources into a Data Warehouse/Data Lake.</li> <li>Experience with a variety of data storage platforms (Snowflake {preferred}, Redshift, MySQL, Postgres, Oracle,&nbsp; RDS)</li> <li>Expert proficiency in SQL</li> <li>Deep understanding and application of modern data processing technology and real-time/low-latency data pipeline and ETL architectures</li> <li>Strong stakeholder interaction and influence experience at executive, business stakeholder, and engineering team levels</li> <li>Bachelor degree or equivalent experience</li> </ul>

analytics

matillion

snowflake-schema

Senior Data Engineer &ndash; ETL Pipelines - Python - Cybersecurity Full-Time | 100% Remote Austin, TX Please, no agencies *Do you like creating pipelines to ingest and maintain complex data sets for use in ML models? *Have you worked with machine learning teams and data scientists? *Do you have a passion for using your experience with Python, Spark, or similar technologies like Hive/Kafka/HBase? *Do you like pirates, and Arrrrr you interested in writing code that provides intrusion detection? *Do you want to help Google, Microsoft, Salesforce, and Cisco defend against cyber attacks? *Do you want stock? A fat base? And a bonus? *And finally, do you want to work for cool managers who care about clean code? THEN CHECK. THIS. OUT. Position Overview: From software hacking to hardware hacking, we help secure everything from cryptocurrency exchanges and space telescopes to autonomous vehicles and the electric grid. Today, our client is making significant investments in terms of financial and engineering resources to develop a radically new customer experience we call &ldquo;Security-as-a-Service&rdquo; to provide customers with a unified, efficient, and data-driven security platform. We&rsquo;re looking to add the right individual to their growing team supporting the next wave of cybersecurity products and solutions. As part of that investment, we&rsquo;re seeking a seasoned Data Engineer with a successful track record in data engineering in a hyper growth company setting. You will have the opportunity to work with some of the best security engineers in the world who hail from organizations such as Amazon, CIA, Facebook, Google, Microsoft, NSA, Redhat, Sun Microsystems, and US Air Force. As an Inc. Best Places to Work, Inc. 500 | 5000, Cybersecurity 500, and Austin Fast 50 Award recipient, we are seeking an individual that understands the professional and personal growth attached to this opportunity and who has the corresponding internal drive to maximize it. Career opportunity: <ul> <li>Join an industry with massive socio, economic, and political importance in the 21st century&nbsp;</li> <li>Work alongside some of the best and the brightest minds in the security industry&nbsp;</li> <li>Leave an indelible mark on a company where individual input has real impact&nbsp;</li> <li>Be recognized, internally and publicly, for your contributions in a high-profile position&nbsp;</li> <li>Align your career trajectory with a hyper growth company that is on the move</li> </ul> Core responsibilities: <ul> <li>Create pipelines to ingest and maintain complex data sets into our client&rsquo;s data stores for use in machine learning models</li> <li>Create tools to scour the internet to find important security information and ingest it into their infrastructure</li> <li>Work with data scientists to create and maintain data ontologies for security&nbsp;</li> <li>Create the roadmap of how to continually evolve the data engineering infrastructure and techniques to improve our client&rsquo;s ability to find security information&nbsp;</li> <li>Mentor junior data engineers and teach them how to use data engineering techniques to solve real world problems</li> <li>Communicate complex concepts to team members</li> </ul> Accountable for: <ul> <li>Creation of data engineering pipelines to find and ingest security vulnerabilities&nbsp;</li> <li>Creation of data engineering tools to help label and validate data&nbsp;</li> </ul> Required qualifications: <ul> <li>At least 8 years experience designing and building data processing/ETL pipelines</li> <li>At least 8 years experience in Python and Spark or similar technologies [[ Hive / Kafka / HBase ]]</li> <li>At least 8 years experience with SQL and relational databases</li> <li>At least 8 years experience parsing flat files&nbsp;</li> <li>At least 8 years development experience</li> <li>Prior track record in a hyper-growth, high-tech company</li> <li>Bachelor's degree or equivalent practical experience</li> </ul> Desired qualifications: <ul> <li>Experience working with Google Tensorflow&nbsp;</li> <li>Experience with modern technology stacks</li> <li>Experience with micro-services architectures</li> <li>Experience with cloud platforms and SaaS solutions</li> <li>Experience with agile/scrum development practices</li> <li>Experience with test driven development, continuous integration, continuous deployment</li> <li>Experience with Git, JIRA, Confluence</li> <li>Experience with Google Compute, Firebase, and GKE</li> <li>Experience with Docker</li> </ul> Desired behaviors: <ul> <li>Relentless restlessness to turn theory into practice and develop production worthy code that solves real-world customer problems</li> <li>Determination to always learn and get better and never rest on ones laurels</li> <li>Personable individual who enjoys working in a team-oriented environment</li> <li>Comfort dealing with ambiguity in an environment where we build the plane as we fly it</li> <li>Ability to work within constraints and to challenge the status quo</li> <li>Ability to self-direct work and truly own the position in a hyper-growth environment&nbsp;</li> </ul> Compensation package: <ul> <li>Competitive compensation</li> <li>Ownership opportunity through employee stock option plan&nbsp;</li> <li>Health, dental, and vision insurance&nbsp;</li> <li>4% company 401K matching vested immediately&nbsp;</li> </ul>

security

pyspark

machine-learning

Senior Data Engineer  ETL Pipelines

We&rsquo;re looking for data fanatics to join the A Team of engineers and analysts that are responsible for building Quadpay&rsquo;s data infrastructure. We need people who understand data at a granular level &ndash; they don&rsquo;t rely on any one tool but rather understand them all, and each of their pros and cons. This is a unique opportunity to build the data strategy and architecture at a data driven startup that&rsquo;s changing the world of finance, shoulder to shoulder with a tight team that has your back. You dream in code: <ul> <li>SQL. Teach us something new, show us what you&rsquo;ve got</li> <li>Python/Scala/C# You&rsquo;ve coded before, you know the importance of efficient, clean code</li> </ul> You thrive in any data environment: <ul> <li>Cloud &ndash; we use Azure&nbsp;</li> <li>Someone who understands complex data and the challenges of accessing it&nbsp;</li> <li>A real bottom-line person, not someone who throws terms like &ldquo;big data&rdquo; around because it&rsquo;s popular&nbsp;</li> <li>Traditional/relational databases, Lakes, or Pub/Subs make no difference to you</li> </ul> You know databases inside and out: <ul> <li>Database concepts &ndash; indexes, execution engines, etc&nbsp;</li> <li>Database Administration experience (Azure DWH, SqlServer, Postgresql)&nbsp;</li> <li>You understand that databases are an integral part of being a Data Engineer</li> </ul> You enjoy looking at and solving big picture problems: <ul> <li>You like to ask questions and devise a complete solution&nbsp;</li> <li>You want to understand the data (not only the pipes) and you can definitely perform some analytics and build dashboards because you like it.</li> </ul> You love learning new things: <ul> <li>You know that you don&rsquo;t know enough, and it bothers you that there isn&rsquo;t enough time in the day to learn about the next topic.&nbsp;</li> <li>You&rsquo;re up-to-date on new trends in data &ndash; you know who&rsquo;s using what to solve various problems and are excited for the next release of your favorite tool&nbsp;</li> <li>If you like being thrown in the deep end of the pool, this team&rsquo;s for you.</li> </ul> You&rsquo;re a culture fit: <ul> <li>You believe and want to participate in a blameless culture which focuses on process and technology&nbsp;</li> <li>You don&rsquo;t sleep well at night when you leave work with a question unanswered&nbsp;</li> <li>You feel accountable for everything you do and that sense of urgency has been driving you your entire life&nbsp;</li> <li>You like to have a good time while getting things done&nbsp;</li> <li>When we say a &ldquo;team player&rdquo; we mean it - you have a crisp high-five and funny stories to tell&nbsp;</li> <li>You have your team&rsquo;s back. And the team has yours.&nbsp;</li> <li>Sense of humor is hugely preferred</li> </ul> Technology is changing the way people interact with the world and we&rsquo;re bringing that revolution to the way people shop and transact. We allow shoppers to buy anywhere, at anytime - and pay in 4 interest-free, automatic installments over 6 weeks. You get the product right away and QuadPay will pay the merchant upfront.&nbsp; We're looking for someone who can join our high-functioning team of passionate support professionals and we value a range of diverse backgrounds, experiences, and ideas. We pride ourselves on diversity and creating an inclusive workplace that provides equal opportunities to all persons regardless of age, race, color, religion, sex, sexual orientation, gender identity and expression, national origin, disability, military and/or veteran status, or any other protected classes. We're growing very quickly and always looking for talented people to join our team and help transform the way consumers shop and pay!

Remote etl Jobs

Browse remote etl jobs in December 2020