Cloud Computing

부하테스트 도구 및

manager@ 2013. 2. 26. 19:44


부하 테스트 툴


Python 기반 web browsing, web crawl


  • Spynner is a stateful programmatic web browser module for Python with Javascript/AJAX support based upon the QtWebKit framework



What is Scrapy?

  • scrapy : python 에서 크롤링 할때 사용하는 대표적인 오픈소스로서, 크롤링을 우아하고 쉽게 할 수 있게 도와준다.

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.