Skip to content
Snippets Groups Projects
  1. Oct 18, 2017
  2. Oct 17, 2017
  3. Oct 16, 2017
  4. Oct 12, 2017
  5. Oct 10, 2017
  6. Sep 27, 2017
  7. Sep 05, 2017
  8. Aug 30, 2017
  9. Jul 28, 2017
  10. Jul 26, 2017
  11. Jul 25, 2017
    • moranegg's avatar
      Added level of abstraction in indexers to use BaseIndexer for revisions · 51ede3e3
      moranegg authored
      Summary:
      - renaming methods filter_contents to filter and index_content to index
      in all sub-classes and orchestrator
      - renaming dependencies to ContentIndexer instead of BaseIndexer
      - renaming in tests
      
      Added RevisionMetadataIndexer with a detection tool for metadata
      
      - RevisionMetadataIndexer takes a list of revisions and detects
      in the root directory all the file names supported by the
      swh-metadata-detector version 0.0.1 that can contain metadata
      
      - checks if files where translated before in the content_metadata
      table
      
      - if not: sends the files to indexation
      
      - aggregates results
      
      Note: should keep results in revision_metadata but this part
      is not ready in the storage
      - also, changed init of ContentMetadataIndexer with tool in args
      
      Updated documentation with new revision indexer
      
      Test Plan: WIP (will be updated today)
      
      Reviewers: ardumont
      
      Differential Revision: https://forge.softwareheritage.org/D233
      51ede3e3
    • moranegg's avatar
      Added RevisionMetadataIndexer with a detection tool for metadata · 0f0ade3a
      moranegg authored
      - RevisionMetadataIndexer takes a list of revisions and detects
      in the root directory all the file names supported by the
      swh-metadata-detector version 0.0.1 that can contain metadata
      
      - checks if files where translated before in the content_metadata
      table
      
      - if not: sends the files to indexation
      
      - aggregates results
      
      Note: should keep results in revision_metadata but this part
      is not ready in the storage
      - also, changed init of ContentMetadataIndexer with tool in args
      0f0ade3a
  12. Jul 24, 2017
  13. Jul 11, 2017
  14. Jun 28, 2017
    • Morane Otilia Gruenpeter's avatar
      First draft of the metadata content indexer for npm (package.json) · 53eccf57
      Morane Otilia Gruenpeter authored
      Summary:
      for indexing content in  content_metadata we want to use metadata tools
      to extract metadata from manifest files and keep in same format(syntax) and with same terms(semantic)
      
      temp solution:
      in Metadata_Dictionary class dispatch the content for parsing and translation
      using hard coded mapping (should be extracted from storage) to translate package.json files
      to codemeta terms
      
      testing:
      in test_metadata 3 running tests for the compute_metadata function with and without content
      and for the metadata indexer (the storage part of it isn't implemented) with local npm mapping
      
      Differential Revision: https://forge.softwareheritage.org/D215
      
      Refactor metadata dictionary with a class for each mapping
      
      change to compute_metadata without a MetaDict class
      added a tools mapping to help with dispatch
      added convert function to decode content
      
      note: delete compare function that returns a wrong result
      53eccf57
  15. Jun 13, 2017
  16. Jun 12, 2017
  17. Jun 07, 2017
  18. Jun 06, 2017
  19. Jun 02, 2017
  20. Jun 01, 2017
  21. May 29, 2017
  22. May 22, 2017
  23. May 17, 2017
Loading