{"id":1044209,"date":"2021-03-28T00:00:00","date_gmt":"2021-03-28T00:00:00","guid":{"rendered":"https:\/\/www.beyondsoft.com\/sg\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/"},"modified":"2021-03-28T00:00:00","modified_gmt":"2021-03-28T00:00:00","slug":"imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration","status":"publish","type":"customer-story","link":"https:\/\/www.beyondsoft.com\/jp\/en\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/","title":{"rendered":"Imagine Communications boosts performance and scalability with AWS cloud migration"},"content":{"rendered":"<p><strong>THE CHALLENGE<\/strong><\/p>\n\n\n<p>The Imagine Communications Research and Development data team challenge was twofold. First, they had to reduce prohibitive overhead and operational costs associated with developing a new product on Azure using Microsoft SQL Server. Second, they needed to deliver a new analytics platform built to leverage their existing analytic tools, provide instant elasticity, integrate multiple data sources, and reduce time to deliver new products and services.<\/p>\n\n\n<p>This analytics system transforms TV ratings data provided by Nielsen and ComScore spanning more than 200 geographic markets in a single serverless Data Lake.<\/p>\n\n\n<p><strong>THE SOLUTION<\/strong><\/p>\n\n\n<p>After a thorough consultation and evaluation, the Beyondsoft Big Data team proposed a solution built on AWS cloud-native services, comprised of Athena, Glue, Redshift, and Redshift Spectrum. The project also included the easy deployment of Redshift clusters and event-driven pipelines to allow Imagine Communications to move large amounts of daily generated data to a Redshift cluster.<\/p>\n\n\n<p>Beyondsoft also implemented tuning and revision of the former workflow. Changes included:<\/p>\n\n\n<ul class=\"wp-block-list\"><li>Historical data and real-time data provided by Nielsen and ComScore, the rating agencies, is now stored in S3, consisting of more than 1 million files and more than 50 TB of uncompressed data.<\/li><li>The input data comes in a mainframe-like format, so a Lambda\/Python function was used to convert to S3 in JSON format. Lambda functions were used for high concurrency data processing for S3 files and were invoked more than 1 million times to process more than 800,000 files in one hour.<\/li><li>To save money, the S3\/JSON data was converted to Parquet format using Spark which runs in Fargate containers. <\/li><li>The Glue Catalog has more than 2,000 tables that is queried by Athena.<\/li><li>The Parquet-formatted data stored in S3 was moved to Redshift Spectrum and Redshift Clusters via staging tables.<\/li><li>The Redshift cluster, which is a 2-node RA3 configuration, houses more than 20TB of raw data for 4 years.<\/li><li>The ETL into the Redshift cluster is done by Python\/SQL using Fargate containers.<\/li><li>The Reporting UI now communicates to the Redshift spectrum and Redshift cluster through C# API.<\/li><\/ul>\n\n\n<p><\/p>\n\n\n<p>By implementing the AWS managed services stack and architectural advancements, the Beyondsoft Big Data team successfully delivered a scalable, truly elastic, and highly performant data solution that also met Imagine Communications\u2019 stringent success criteria. By moving to the AWS cloud platform, the overall cost to operate the new solution dropped from an average of $200,000 per month to an average of $5,000 per month.<\/p>\n\n\n<p><strong>KNOWLEDGE TRANSFER<\/strong><\/p>\n\n\n<p>During the engagement with Imagine Communications, the Beyondsoft team also provided education and training, so that the Imagine Communications Data Analytics Team could take ownership of the newly developed environment. As a practice, the Beyondsoft Big Data Team developed and delivered a runbook, so that Imagine Communications could not only manage the newly provided data platform, but also add to the solution in the future.<\/p>\n\n\n<p><strong>BENEFITS<\/strong><\/p>\n\n\n<p>Migrating from Microsoft SQL Server on Azure to Redshift on Amazon Web Services provided Imagine Communications with increased performance, high scalability, and faster data processing by leveraging a sophisticated data lake solution.<\/p>\n\t\t\n\t\t\t<a href=\"http:\/\/www.beyondsoft.com\/wp-content\/uploads\/2021\/05\/Imagine-Communications-boosts-performance-and-scalability-with-AWS-cloud-migration.pdf\" role=\"button\">\n\t\t\t\t\t\tDownload Case Study\n\t\t\t\t\t<\/a>","protected":false},"excerpt":{"rendered":"<p>Imagine Communications is a Texas-based leading Television Broadcast Media company. Imagine Communications makes it possible for their clients to create digital content anywhere in the world and on any device or platform, but as the way people watch TV evolves and continues to change, media companies must maintain nimbleness in order to monetize their data.<\/p>","protected":false},"featured_media":1044135,"template":"","meta":{"_links_to":"","_links_to_target":""},"service-category":[8],"industry-category":[44],"external-author":[],"class_list":["post-1044209","customer-story","type-customer-story","status-publish","has-post-thumbnail","hentry","service-category-cloud-adoption-and-transformation","industry-category-others"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.2 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.beyondsoft.com\/jp\/en\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft\" \/>\n<meta property=\"og:description\" content=\"Imagine Communications is a Texas-based leading Television Broadcast Media company. Imagine Communications makes it possible for their clients to create digital content anywhere in the world and on any device or platform, but as the way people watch TV evolves and continues to change, media companies must maintain nimbleness in order to monetize their data.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.beyondsoft.com\/jp\/en\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/\" \/>\n<meta property=\"og:site_name\" content=\"IT Solutions Company Japan | Beyondsoft\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/\",\"url\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/\",\"name\":\"Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft\",\"isPartOf\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg\",\"datePublished\":\"2021-03-28T00:00:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage\",\"url\":\"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg\",\"contentUrl\":\"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg\",\"width\":724,\"height\":483},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.beyondsoft.com\/jp\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Customer Stories\",\"item\":\"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Imagine Communications boosts performance and scalability with AWS cloud migration\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#website\",\"url\":\"https:\/\/www.beyondsoft.com\/jp\/\",\"name\":\"IT Solutions Company Japan | Beyondsoft\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.beyondsoft.com\/jp\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#organization\",\"name\":\"IT Solutions Company Japan | Beyondsoft\",\"url\":\"https:\/\/www.beyondsoft.com\/jp\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/logo-1.webp\",\"contentUrl\":\"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/logo-1.webp\",\"width\":251,\"height\":66,\"caption\":\"IT Solutions Company Japan | Beyondsoft\"},\"image\":{\"@id\":\"https:\/\/www.beyondsoft.com\/jp\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.beyondsoft.com\/jp\/en\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/","og_locale":"en_US","og_type":"article","og_title":"Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft","og_description":"Imagine Communications is a Texas-based leading Television Broadcast Media company. Imagine Communications makes it possible for their clients to create digital content anywhere in the world and on any device or platform, but as the way people watch TV evolves and continues to change, media companies must maintain nimbleness in order to monetize their data.","og_url":"https:\/\/www.beyondsoft.com\/jp\/en\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/","og_site_name":"IT Solutions Company Japan | Beyondsoft","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/","url":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/","name":"Imagine Communications boosts performance and scalability with AWS cloud migration - IT Solutions Company Japan | Beyondsoft","isPartOf":{"@id":"https:\/\/www.beyondsoft.com\/jp\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage"},"image":{"@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage"},"thumbnailUrl":"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg","datePublished":"2021-03-28T00:00:00+00:00","breadcrumb":{"@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#primaryimage","url":"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg","contentUrl":"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/imagine-communication-1.jpg","width":724,"height":483},{"@type":"BreadcrumbList","@id":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/imagine-communications-boosts-performance-and-scalability-with-aws-cloud-migration\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.beyondsoft.com\/jp\/"},{"@type":"ListItem","position":2,"name":"Customer Stories","item":"https:\/\/www.beyondsoft.com\/jp\/customer-stories\/"},{"@type":"ListItem","position":3,"name":"Imagine Communications boosts performance and scalability with AWS cloud migration"}]},{"@type":"WebSite","@id":"https:\/\/www.beyondsoft.com\/jp\/#website","url":"https:\/\/www.beyondsoft.com\/jp\/","name":"IT Solutions Company Japan | Beyondsoft","description":"","publisher":{"@id":"https:\/\/www.beyondsoft.com\/jp\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.beyondsoft.com\/jp\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.beyondsoft.com\/jp\/#organization","name":"IT Solutions Company Japan | Beyondsoft","url":"https:\/\/www.beyondsoft.com\/jp\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.beyondsoft.com\/jp\/#\/schema\/logo\/image\/","url":"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/logo-1.webp","contentUrl":"https:\/\/www.beyondsoft.com\/jp\/wp-content\/uploads\/sites\/4\/2023\/12\/logo-1.webp","width":251,"height":66,"caption":"IT Solutions Company Japan | Beyondsoft"},"image":{"@id":"https:\/\/www.beyondsoft.com\/jp\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/customer-story\/1044209","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/customer-story"}],"about":[{"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/types\/customer-story"}],"version-history":[{"count":0,"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/customer-story\/1044209\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/media\/1044135"}],"wp:attachment":[{"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/media?parent=1044209"}],"wp:term":[{"taxonomy":"service-category","embeddable":true,"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/service-category?post=1044209"},{"taxonomy":"industry-category","embeddable":true,"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/industry-category?post=1044209"},{"taxonomy":"external-author","embeddable":true,"href":"https:\/\/www.beyondsoft.com\/jp\/en\/wp-json\/wp\/v2\/external-author?post=1044209"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}