• 设为首页
  • 点击收藏
  • 手机版
    手机扫一扫访问
    迪恩网络手机版
  • 关注官方公众号
    微信扫一扫关注
    迪恩网络公众号

john-sandall/maven: Maven provides easy access to open datasets in both raw and ...

原作者: [db:作者] 来自: 网络 收藏 邀请

开源软件名称(OpenSource Name):

john-sandall/maven

开源软件地址(OpenSource Url):

https://github.com/john-sandall/maven

开源编程语言(OpenSource Language):

Python 100.0%

开源软件介绍(OpenSource Introduction):

Maven

/meɪvən/ – a trusted expert who seeks to pass timely and relevant knowledge on to others.

Maven's goal is to reduce the time data scientists spend on data cleaning and preparation by providing easy access to open datasets in both raw and processed formats.

Maven was built to:

  • Improve availability and integrity of open data by eliminating data issues, adding common identifiers, and reshaping data to become model-ready.
  • Source data in its rawest form from the most authoritative data provider available with all transformations available as open source code to enhance integrity and trust.
  • Honour data licences wherever possible whilst avoiding potential issues relating to re-distribution of data (especially open datasets where no clear licence is provided) by performing all data retrieval and processing on-device.

Install

pip install maven

Usage

import maven
maven.get('general-election/UK/2017/results', data_directory='./data/')

Datasets

Data dictionaries for all datasets are available by clicking on the dataset's name.

Dataset Description Date Source Licence
Coronavirus Datasets
coronavirus/CSSE Daily CSSE cases/deaths/recovered by country/region/state Updated daily Johns Hopkins Center for Systems Science and Engineering See "Terms of Use" on CSSE repo
UK Political Datasets
general-election/UK/2010/results UK 2010 General Election results 6th May 2010 House of Commons Library Open Parliament Licence v3.0
general-election/UK/2015/results UK 2015 General Election results 7th May 2015 House of Commons Library Open Parliament Licence v3.0
general-election/UK/2017/results UK 2017 General Election results 8th June 2017 House of Commons Library Open Parliament Licence v3.0
general-election/UK/2015/model Model-ready datasets for forecasting the 2015 UK General Election 2010 & 2015 data uk_2015_model.py Mixed
general-election/UK/2017/model Model-ready datasets for forecasting the 2017 UK General Election 2015 & 2017 data uk_2017_model.py Mixed
general-election/UK/polls UK General Election opinion polling May 2005 - June 2017 SixFifty Unknown

Running tests

To run tests against an installed version (either pip install . or pip install maven):

$ cd /path/to/repo
$ pytest

To run tests whilst in development:

$ cd /path/to/repo
$ python -m pytest

Licences

Name Description Attribution Statement
Open Parliament Licence Free to copy, publish, distribute, transmit, adapt and exploit commercially or non-commercially. See URL for full details. Contains Parliamentary information licensed under the Open Parliament Licence v3.0.
Open Government Licence Free to copy, publish, distribute, transmit, adapt and exploit commercially and non-commercially. See URL for full details. Contains public sector information licensed under the Open Government Licence v2.0.

Contributing

Maven was designed for your contributions!

  1. Check for open issues or open a fresh issue to start a discussion around your idea or a bug.
  2. Fork the repository on GitHub to start making your changes to the master branch (or branch off of it).
  3. For new datasets ensure the processed dataset is fully documented with a data dictionary. For new features and bugs, please write a test which shows that the bug was fixed or that the feature works as expected.
  4. Send a pull request and bug the maintainer until it gets merged and published.

鲜花

握手

雷人

路过

鸡蛋
该文章已有0人参与评论

请发表评论

全部评论

专题导读
热门推荐
阅读排行榜

扫描微信二维码

查看手机版网站

随时了解更新最新资讯

139-2527-9053

在线客服(服务时间 9:00~18:00)

在线QQ客服
地址:深圳市南山区西丽大学城创智工业园
电邮:jeky_zhao#qq.com
移动电话:139-2527-9053

Powered by 互联科技 X3.4© 2001-2213 极客世界.|Sitemap