Create a new production webapp using the frozen index on the staging ES

In order to test the swh-search behavior with real data, a webapp will be created and configured to use the production data and the cold swh-search index hosted on the staging ES node.

It's a cold index not updated since some time, but it a first step until a production ES cluster with live data is installed and backfilled with real data

---

Migrated from T2904 (view on Phabricator)

assigned to @vsellier

marked this issue as related to #2590 (closed)

added Archive search Journal System administrators priority:Normal labels

marked this issue as related to swh/infra/sysadm-environment#2905 (closed)

added state:wip label

mentioned in commit swh/devel/swh-search@5560ba0a

In prevision of the deployment, the production index present on the staging's elasticsearch was renamed from origin-production2 to production_origin (a clone operation will be user [1], the original index will be let in place)

• [1] https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-clone-index.html

vsellier@search-esnode0 ~ % export ES_SERVER=192.168.130.80:9200

vsellier@search-esnode0 ~ % curl -XPOST -s http://${ES_SERVER}/origin-production2/_open\?pretty
{
  "acknowledged" : true,
  "shards_acknowledged" : true
}

vsellier@search-esnode0 ~ % curl  -s http://${ES_SERVER}/_cat/indices\?v
health status index              uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   origin-production2 P5qDO-jmQsmUOY1CI6hUcQ  80   0   91517657            0     65.3gb         65.3gb
green  open   origin             T0AItBcEQqKbS7FlmOs6yA  80   0     408275         1067    274.3mb        274.3mb

# make it read-only
vsellier@search-esnode0 ~ % curl -XPUT -H"Content-Type: application/json" http://${ES_SERVER}/origin-production2/_settings -d'{ "settings": { "index.blocks.write": true } }'
{"acknowledged":true}%  

vsellier@search-esnode0 ~ % curl -XPOST http://${ES_SERVER}/origin-production2/_clone/production_origin\?pretty
{
  "acknowledged" : true,
  "shards_acknowledged" : true,
  "index" : "production_origin"
}

vsellier@search-esnode0 ~ % curl -XPOST -s http://${ES_SERVER}/origin-production2/_close\?pretty
{
  "acknowledged" : true,
  "shards_acknowledged" : true,
  "indices" : {
    "origin-production2" : {
      "closed" : true
    }
  }
}

vsellier@search-esnode0 ~ % curl -XPUT -H "Content-Type: application/json" http://$ES_SERVER/production_origin/_settings -d '{"index": { "number_of_replicas":0 }}' 
{"acknowledged":true}% 

vsellier@search-esnode0 ~ % curl  -s http://${ES_SERVER}/_cat/indices\?v                                                                                                     
health status index              uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  close  origin-production2 P5qDO-jmQsmUOY1CI6hUcQ  80   0                                                  
green  open   origin             T0AItBcEQqKbS7FlmOs6yA  80   0     408338         1084    285.8mb        285.8mb
green open   production_origin  _jEfDEzNQeONKiY3tm3zmw  80   0   91517657            0     65.3gb         65.3gb

mentioned in commit swh/infra/puppet/puppet-swh-site@fcc7b923

mentioned in commit swh/infra/puppet/puppet-environment@181f6cde

mentioned in commit swh/infra/puppet/puppet-swh-site@c33c839b

The webapp is available at https://webapp1.internal.softwareheritage.org

Reminder: the data on the index are quite old an not updated. The deployment of a real swh-search will be handled on swh/infra/sysadm-environment#2905 (closed)

removed state:wip label

closed

mentioned in commit swh/infra/puppet/puppet-swh-site@68ba4af7