User-agent: *
Allow: / 

Disallow: /data/ 
Disallow: /api/ 
Disallow: /sem/
Disallow: /*?*