output/blog/2020/08/02/latest-provider-pricing-data-available-in-s3-bucket.html - libcloud-site - Git at Google

 <!DOCTYPE html>
 <html lang="en">
   <head>
     <meta charset="utf-8">
     <meta name="viewport" content="width=device-width, initial-scale=1.0">


     <meta name="author" content="The Apache Software Foundation">


       <meta name="keywords" content="news,pricing data" />


       <title>Latest up to date provider pricing.json data file is now available in an S3 bucket | Apache Libcloud</title>


     <!-- fav icons -->
     <link rel="shortcut icon" href="/images/favicon.png" />
     <link rel="apple-touch-icon" href="/images/apple-touch-icon.png" />
     <link rel="apple-touch-icon-precomposed" href="/images/apple-touch-icon.png" />

     <link href="/blog/atom.xml" type="application/atom+xml" rel="alternate" title="Apache Libcloud Blog Feed" />

     <!-- Facebook OpenGraph tags -->
     <meta content="Apache Libcloud" property="og:site_name">

       <meta content="Latest up to date provider pricing.json data file is now available in an S3 bucket" property="og:title">


       <meta content="article" property="og:type">


       <meta content="https://libcloud.apache.org/blog/2020/08/02/latest-provider-pricing-data-available-in-s3-bucket.html" property="og:url">


       <meta content="2020-08-02T00:00:00+00:00" property="article:published_time">
       <meta content="https://libcloud.apache.org/about.html" property="article:author">


       <meta content="news" property="article:tag">

       <meta content="pricing data" property="article:tag">


     <link href='/assets/global-1768bfa479597eed443be67c5aec2edc.css' rel='stylesheet' type='text/css' />
   </head>

   <body data-spy="scroll" data-target=".sidebar-nav" data-offset="80">
     <nav class="navbar navbar-fixed-top navbar-inverse" role="navigation">
       <div class="container">
         <div class="navbar-header">
           <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-ex1-collapse">
             <span class="sr-only">Toggle navigation</span>
             <span class="icon-bar"></span>
             <span class="icon-bar"></span>
             <span class="icon-bar"></span>
           </button>
           <a class="navbar-brand" href="/"><img src="/images/libcloud_logo.png" class="navbar-logo" /> Apache Libcloud</a>
         </div>
         <div class="collapse navbar-collapse navbar-ex1-collapse">
           <ul class="nav navbar-nav">


               <li ><a href="/" >Home</a></li>


               <li ><a href="/about.html" >About</a></li>


               <li ><a href="/getting-started.html" >Quick Start</a></li>


               <li ><a href="https://libcloud.readthedocs.org/en/stable/" target="_blank">Documentation</a></li>


               <li ><a href="/downloads.html" >Downloads</a></li>


               <li ><a href="/community.html" >Community</a></li>


               <li ><a href="/blog/" >Blog</a></li>

           </ul>

           <div class="material-switch pull-right">
               <input id="theme-switch" name="theme-switch" type="checkbox" onclick="modeSwitcher()"/>
               <label for="theme-switch" class="label-default"></label>
               <span id="theme-toggle" class="theme-switch">Dark mode</span>
           </div>

         </div><!-- /.navbar-collapse -->
       </div><!-- /.container -->
     </nav>

     <div class="container main-container">
       <div class="row section page-content">
   <div class="col-lg-8 col-lg-offset-2">

 <div class="post">

     <h2 class="post-title">Latest up to date provider pricing.json data file is now available in an S3 bucket</h2>

   <span class="post-date-author">By Tomaz Muraus on Aug 02, 2020</span>

   <div class="post-content">
     <p>Recently we added a new job to our CI / CD which runs daily and retrieves latest
 pricing data for various providers and publishes pricing.json file which can be
 used by Libcloud to a public read-only S3 bucket.</p>

 <p>More information on where to download it and how to use this file can be found in
 <a href="https://libcloud.readthedocs.io/en/latest/compute/pricing.html#downloading-latest-pricing-data-from-an-s3-bucket">our documentation</a>.</p>

 <h2 id="background-context">Background, Context</h2>

 <p>In the past, we ran the script which updates pricing.json file which is bundled
 with each Libcloud release just before publishing a new release.</p>

 <p>The problem is that the pricing data can change often, so updating it only once
 every couple of months as part of a Libcloud release is not sufficient.</p>

 <p>To solve for that problem, we now update and publish pricing.json file which
 includes latest retrieved pricing data for various providers on a daily basis.</p>

 <p>It’s worth noting that we can’t guarantee 100% accuracy of this data so you
 should only use this data as estimate and you should never rely solely on
 Libcloud pricing data.</p>

 <h2 id="thanks">Thanks</h2>

 <p>We would like to extend special thanks to <a href="https://github.com/Eis-D-Z">Eis D. Zaster</a> who has
 contributed new scraping scripts for multiple providers and also made
 various improvements and fixes to the existing scraping scripts.</p>

 <p>In addition to that, we would like to thank <a href="https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/">Amazon Web Services</a> which
 granted us free credits for their EC2 and S3 service which we plan to use
 for hosting this pricing file, end to end tests and more.</p>


   </div>

   <div class="row section post-meta">
     <div class="col-md-12 post-tags">
       <p>Tags: <a href="/blog/tags/news.html" rel="tag">news</a>, <a href="/blog/tags/pricing-data.html" rel="tag">pricing data</a></p>
     </div>
   </div>
 </div>


   </div>
 </div>


       <hr />

       <footer>
         <div class="row">
           <div class="col-lg-12 text-center">
             <div class="footer-links">
   <p><a href="http://www.apache.org/licenses/">License</a> | <a
   href="/security.html">Security</a> | <a
   href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a> |
   <a href="http://www.apache.org/foundation/thanks.html">Thanks</a> |
   <a href="https://www.apache.org/events/">Events</a> |
   <a href="/credits.html">Credits</a> | <a href="/media.html">Media</a>
 </div>

 <div class="footer-text">
   <p><a class="acevent" data-format="wide"></a></p>
   <p class="">Copyright &copy; 2009-2023 <a href="https://www.apache.org/" target="_blank">The Apache Software Foundation</a></p>
   <p class="">Apache Libcloud, Libcloud, Apache, the Apache feather, and the Apache Libcloud project logo are trademarks of the Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
   <p class="">Site last updated on 2023-09-09 21:33:21 +0000</p>
 </div>

           </div>
         </div>
       </footer>

     </div><!-- /.container -->

     <!-- JavaScript -->
     <script src='/assets/global-20157a00c0e17a775f45ed99ccdf79d7.js' type='text/javascript'></script>


     <script type="text/javascript">
   var _paq = window._paq = window._paq || [];
   /* tracker methods like "setCustomDimension" should be called before
 "trackPageView" */
   /* We explicitly disable cookie tracking to avoid privacy issues */
   _paq.push(['disableCookies']);
   _paq.push(['trackPageView']);
   _paq.push(['enableLinkTracking']);
   (function() {
     var u="https://analytics.apache.org/";
     _paq.push(['setTrackerUrl', u+'matomo.php']);
     _paq.push(['setSiteId', '7']);
     var d=document, g=d.createElement('script'),
 s=d.getElementsByTagName('script')[0];
     g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s);
   })();
 </script>

     <script src="https://www.apachecon.com/event-images/snippet.js"></script>

   </body>
 </html>
	<!DOCTYPE html>
	<html lang="en">
	<head>
	<meta charset="utf-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">



	<meta name="author" content="The Apache Software Foundation">


	<meta name="keywords" content="news,pricing data" />



	<title>Latest up to date provider pricing.json data file is now available in an S3 bucket \| Apache Libcloud</title>


	<!-- fav icons -->
	<link rel="shortcut icon" href="/images/favicon.png" />
	<link rel="apple-touch-icon" href="/images/apple-touch-icon.png" />
	<link rel="apple-touch-icon-precomposed" href="/images/apple-touch-icon.png" />

	<link href="/blog/atom.xml" type="application/atom+xml" rel="alternate" title="Apache Libcloud Blog Feed" />

	<!-- Facebook OpenGraph tags -->
	<meta content="Apache Libcloud" property="og:site_name">

	<meta content="Latest up to date provider pricing.json data file is now available in an S3 bucket" property="og:title">







	<meta content="article" property="og:type">



	<meta content="https://libcloud.apache.org/blog/2020/08/02/latest-provider-pricing-data-available-in-s3-bucket.html" property="og:url">


	<meta content="2020-08-02T00:00:00+00:00" property="article:published_time">
	<meta content="https://libcloud.apache.org/about.html" property="article:author">




	<meta content="news" property="article:tag">

	<meta content="pricing data" property="article:tag">



	<link href='/assets/global-1768bfa479597eed443be67c5aec2edc.css' rel='stylesheet' type='text/css' />
	</head>

	<body data-spy="scroll" data-target=".sidebar-nav" data-offset="80">
	<nav class="navbar navbar-fixed-top navbar-inverse" role="navigation">
	<div class="container">
	<div class="navbar-header">
	<button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-ex1-collapse">
	<span class="sr-only">Toggle navigation</span>
	<span class="icon-bar"></span>
	<span class="icon-bar"></span>
	<span class="icon-bar"></span>
	</button>
	<a class="navbar-brand" href="/"><img src="/images/libcloud_logo.png" class="navbar-logo" /> Apache Libcloud</a>
	</div>
	<div class="collapse navbar-collapse navbar-ex1-collapse">
	<ul class="nav navbar-nav">



	<li ><a href="/" >Home</a></li>


	<li ><a href="/about.html" >About</a></li>


	<li ><a href="/getting-started.html" >Quick Start</a></li>


	<li ><a href="https://libcloud.readthedocs.org/en/stable/" target="_blank">Documentation</a></li>


	<li ><a href="/downloads.html" >Downloads</a></li>


	<li ><a href="/community.html" >Community</a></li>


	<li ><a href="/blog/" >Blog</a></li>

	</ul>

	<div class="material-switch pull-right">
	<input id="theme-switch" name="theme-switch" type="checkbox" onclick="modeSwitcher()"/>
	<label for="theme-switch" class="label-default"></label>
	<span id="theme-toggle" class="theme-switch">Dark mode</span>
	</div>

	</div><!-- /.navbar-collapse -->
	</div><!-- /.container -->
	</nav>

	<div class="container main-container">
	<div class="row section page-content">
	<div class="col-lg-8 col-lg-offset-2">

	<div class="post">

	<h2 class="post-title">Latest up to date provider pricing.json data file is now available in an S3 bucket</h2>

	<span class="post-date-author">By Tomaz Muraus on Aug 02, 2020</span>

	<div class="post-content">
	<p>Recently we added a new job to our CI / CD which runs daily and retrieves latest
	pricing data for various providers and publishes pricing.json file which can be
	used by Libcloud to a public read-only S3 bucket.</p>

	<p>More information on where to download it and how to use this file can be found in
	<a href="https://libcloud.readthedocs.io/en/latest/compute/pricing.html#downloading-latest-pricing-data-from-an-s3-bucket">our documentation</a>.</p>

	<h2 id="background-context">Background, Context</h2>

	<p>In the past, we ran the script which updates pricing.json file which is bundled
	with each Libcloud release just before publishing a new release.</p>

	<p>The problem is that the pricing data can change often, so updating it only once
	every couple of months as part of a Libcloud release is not sufficient.</p>

	<p>To solve for that problem, we now update and publish pricing.json file which
	includes latest retrieved pricing data for various providers on a daily basis.</p>

	<p>It’s worth noting that we can’t guarantee 100% accuracy of this data so you
	should only use this data as estimate and you should never rely solely on
	Libcloud pricing data.</p>

	<h2 id="thanks">Thanks</h2>

	<p>We would like to extend special thanks to <a href="https://github.com/Eis-D-Z">Eis D. Zaster</a> who has
	contributed new scraping scripts for multiple providers and also made
	various improvements and fixes to the existing scraping scripts.</p>

	<p>In addition to that, we would like to thank <a href="https://aws.amazon.com/blogs/opensource/aws-promotional-credits-open-source-projects/">Amazon Web Services</a> which
	granted us free credits for their EC2 and S3 service which we plan to use
	for hosting this pricing file, end to end tests and more.</p>


	</div>

	<div class="row section post-meta">
	<div class="col-md-12 post-tags">
	<p>Tags: <a href="/blog/tags/news.html" rel="tag">news</a>, <a href="/blog/tags/pricing-data.html" rel="tag">pricing data</a></p>
	</div>
	</div>
	</div>


	</div>
	</div>


	<hr />

	<footer>
	<div class="row">
	<div class="col-lg-12 text-center">
	<div class="footer-links">
	<p><a href="http://www.apache.org/licenses/">License</a> \| <a
	href="/security.html">Security</a> \| <a
	href="http://www.apache.org/foundation/sponsorship.html">Sponsorship</a> \|
	<a href="http://www.apache.org/foundation/thanks.html">Thanks</a> \|
	<a href="https://www.apache.org/events/">Events</a> \|
	<a href="/credits.html">Credits</a> \| <a href="/media.html">Media</a>
	</div>

	<div class="footer-text">
	<p><a class="acevent" data-format="wide"></a></p>
	<p class="">Copyright © 2009-2023 <a href="https://www.apache.org/" target="_blank">The Apache Software Foundation</a></p>
	<p class="">Apache Libcloud, Libcloud, Apache, the Apache feather, and the Apache Libcloud project logo are trademarks of the Apache Software Foundation. All other marks mentioned may be trademarks or registered trademarks of their respective owners.</p>
	<p class="">Site last updated on 2023-09-09 21:33:21 +0000</p>
	</div>

	</div>
	</div>
	</footer>

	</div><!-- /.container -->

	<!-- JavaScript -->
	<script src='/assets/global-20157a00c0e17a775f45ed99ccdf79d7.js' type='text/javascript'></script>



	<script type="text/javascript">
	var _paq = window._paq = window._paq \|\| [];
	/* tracker methods like "setCustomDimension" should be called before
	"trackPageView" */
	/* We explicitly disable cookie tracking to avoid privacy issues */
	_paq.push(['disableCookies']);
	_paq.push(['trackPageView']);
	_paq.push(['enableLinkTracking']);
	(function() {
	var u="https://analytics.apache.org/";
	_paq.push(['setTrackerUrl', u+'matomo.php']);
	_paq.push(['setSiteId', '7']);
	var d=document, g=d.createElement('script'),
	s=d.getElementsByTagName('script')[0];
	g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s);
	})();
	</script>

	<script src="https://www.apachecon.com/event-images/snippet.js"></script>

	</body>
	</html>