In this section we will explain how to create a new dashboard for GSICrawler.
We have create the main structure inside demodashboard folder. Open a web browser and visit ``localhost:8090`` to explore this new dashboard.
As you can see there is a google-chart displaying how many news are created each day. To add new web components to your dashboard you have to edit dashboard-gsicrawler.html file inside demodashboard folder.
Search the line that says
.. sourcecode:: html
<!— YOUR NEW COMPONENTS GOES HERE —>
Below this line we are going to add a new web component, in this tutorial we are going to add a number-chart adding:
.. sourcecode:: html
<number-chart></number-chart>
Refresh your web browser and you will see your new number-chart component, but with no data. To add your data change the line added before:
.. sourcecode:: html
<number-chart data="{{data}}"></number-chart>
Refresh your web browser again to see your data. As you can see it has a place for an icon, we can add it typing:
This icon must be stored inside images folder. Refresh your web browser to see your changes.
This web components has many more options like changing the background color, the title... For more information visit https://lab.cluster.gsi.dit.upm.es/sefarad/number-chart.
You can add as Web Components as you want, there are some examples in https://github.com/PolymerElements/
Developing Sefarad dashboards
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you wish to discover more about how to create dashboards, please visit `Sefarad documentation <http://sefarad.readthedocs.io/en/latest/>`_.
\ No newline at end of file
If you wish to discover more about how to create dashboards, please visit `Sefarad documentation <http://sefarad.readthedocs.io/en/latest/dashboard-dev>`_.
<liclass="toctree-l2"><aclass="reference internal"href="tutorials.html#tutorial-iii-semantic-enrichment-and-data-storage">Tutorial III: Semantic enrichment and data storage</a></li>
<liclass="toctree-l2"><aclass="reference internal"href="tutorials.html#tutorial-iv-developing-your-first-dashboard">Tutorial IV: Developing your first dashboard</a></li>
Search.setIndex({docnames:["architecture","gsicrawler","index","tutorials"],envversion:51,filenames:["architecture.rst","gsicrawler.rst","index.rst","tutorials.rst"],objects:{},objnames:{},objtypes:{},terms:{"02t21":3,"03t14":3,"04t18":3,"26z":3,"29z":3,"30z":3,"36z":3,"55km":3,"case":[0,1,3],"class":[0,3],"default":0,"final":[1,3],"function":[0,1],"import":[0,3],"new":[0,1,2],"return":3,For:[0,3],Las:3,One:0,That:0,The:[0,1,3],Then:3,There:3,These:0,_id:3,_index:3,_score:3,_scrapi:3,_search:3,_sourc:3,_type:3,about:[1,3],abov:[0,3],acces:3,access:3,accord:[0,3],acquisit:0,activ:0,add:3,added:3,adding:3,address:3,administr:0,after:0,again:3,agil:0,aim:[0,1],align:3,all:[0,3],allow:[0,3],also:[0,3],ambush:3,analysi:[0,1],analyt:0,analyz:0,ani:0,anoth:0,apart:[0,3],api:[0,3],api_key_meaning_cloud:3,app:2,appear:3,applic:0,approach:[0,1],architectur:[1,2],argument:0,arm:3,articlebodi:3,assad:3,asset:3,attach:0,author:3,automat:0,aux:3,avail:[0,1,3],background:3,baghdadi:3,base:[0,3],bashar:3,becaus:0,been:0,befor:[0,3],behav:0,being:[0,3],belong:0,below:[0,3],better:[0,1],bodi:3,both:[0,3],browser:3,buffer:3,build:[0,3],call:[0,3],can:[0,3],capabl:0,carri:[0,1],categor:0,cdn:3,center:3,central:0,certain:0,certainti:0,chang:3,charg:3,chart:3,citi:3,clear:0,client:0,clone:3,cluster:3,cnn:3,cnnnext:3,code:3,collabor:0,collect:[0,3],color:3,com:3,comfort:0,comment:0,commonli:0,complex:3,compon:[2,3],compos:3,concept:0,concert:3,conclud:0,conflict:3,consist:0,consol:3,contain:[0,3],content:[0,2,3],core:0,could:[0,3],crawl:2,crawler:0,crawlertask:3,creat:3,credenti:3,cron:0,dai:3,dam:3,dashboard:[0,2],data:[0,2],datemodifi:3,datepublish:3,datetim:0,def:3,defin:0,demo:[1,3],demodashboard:3,depend:3,describ:0,desir:0,detail:[0,1,3],develop:2,diagram:0,dict:3,did:3,differ:[0,3],directori:3,discov:[0,3],displai:[0,3],distribut:0,dit:3,divid:0,doc:0,docker:3,document:[0,1,3],domest:3,donald:3,dump:3,each:[0,1,3],edit:3,elast:[0,3],elasticsearch:[0,3],element:3,emot:0,engin:0,enrich:[0,1,2],enter:3,entiti:3,env:3,environ:[0,3],es_endpoint:3,es_endpoint_extern:3,es_port:3,everydai:0,examin:1,exampl:[0,3],execut:3,exist:0,expect:0,explain:[0,1,3],explor:3,expos:1,extens:0,extract:[0,1,3],facilit:0,fast:0,fetch:0,field:3,figur:0,file:[0,3],filepath:3,filesystem:3,filter:0,find:3,finish:3,fire:3,first:2,firstpublishd:3,fit:0,focus:0,folder:3,follow:[0,1,3],forc:3,form:0,format:3,found:3,framework:[0,1],from:[0,1,3],fulful:0,fuseki:[0,3],fuseki_endpoint:3,fuseki_endpoint_extern:3,fuseki_password:3,fuseki_port:3,gather:3,gener:[0,3],geoloc:3,get:2,git:3,github:3,give:0,glanc:2,global:1,goe:3,going:[0,1,3],googl:3,group:0,grow:0,gsi:0,gsicrawl:3,has:[0,3],have:[0,3],hawija:3,headlin:3,heart:0,here:[1,3],high:0,hostil:3,how:[0,3],html:[0,3],http:[0,3],ico:3,icon:3,identif:3,iii:2,imag:3,imagin:0,incid:3,includ:0,incom:0,incurs:3,independ:0,index:[0,3],inform:[0,1,3],ingest:0,initi:3,innov:1,input:0,insid:[0,3],instal:2,instanc:0,instruct:3,interact:[0,1],interfac:[0,1],intern:0,introduc:1,involv:0,iraq:3,iraqi:3,isi:3,its:[0,3],itself:1,jpg:3,json:[0,3],kill:3,known:0,lab:3,las:3,lastli:0,lastmodifiedd:3,later:0,latest:3,level:0,librari:[0,3],like:3,line:3,link:3,local:3,localhost:3,localtarget:3,log:3,luigi:[0,3],made:3,main:[0,3],manag:0,mandatori:0,mani:3,mass:3,meaningcloud:3,method:0,middleeast:3,militari:3,mine:0,modul:[1,2],modular:0,moment:[0,1],more:[0,3],most:[0,1],multipl:0,mum:3,murder:3,must:3,name:[0,3],necessari:0,need:3,newsarticl:3,newsitem:3,next:3,niger:3,nomber:3,now:3,num:3,number:[0,3],obtain:[0,3],offer:[0,3],onc:0,one:[0,3],onli:3,open:[0,3],oper:[0,3],option:3,orchest:0,order:[0,1,3],organ:0,origin:0,other:0,our:3,out:[0,1],outfil:3,output:3,overview:2,page:[1,3],paradigm:0,paramet:[0,3],pars:0,path:3,peopl:3,period:0,petit:0,piec:3,pipelin:[0,3],pipelinetask:3,place:3,platform:[0,1],pleas:[0,3],point:0,polit:3,polym:2,polymerel:3,possibl:[0,3],power:0,presid:3,pretti:3,previou:0,previous:0,print:3,process:[0,3],program:3,project:[1,3],provid:0,queri:0,quickest:3,recaptur:3,receiv:0,recogn:0,reddit:[0,1],refer:0,refresh:3,regim:3,relat:3,remot:0,repositori:3,repres:0,represent:0,request:[0,3],requir:[0,3],respons:[0,3],rest:0,result:[0,3],retriev:0,retrievecnnnew:3,root:3,run:[0,3],russia:3,sai:3,same:0,save:0,schema:3,scrape:[0,3],scraper:[0,3],scrapi:[0,3],search:[0,3],second:3,section:[0,3],see:3,sefarad:[0,3],select:[0,1],self:3,semant:[0,1,2],senpi:[0,3],sent:0,sentenc:0,sentiment:[0,3],sequenc:0,server:2,servic:[0,3],set:[0,3],sever:0,shoot:3,should:3,show:[0,3],shown:0,simpl:0,simpli:0,size:3,solv:0,some:3,sourc:[0,3],spider:0,stack:0,start:2,step:[0,3],storag:[0,2],store:[0,3],stori:3,str:3,strign:0,structur:[0,3],studi:1,sub:0,submodul:0,success:3,sudo:3,surround:3,syria:3,syrian:3,system:[0,1],tag:0,take:0,tanf:3,target:3,task:[2,3],terror:3,text:0,thank:0,thei:3,thi:[0,1,3],third:0,those:3,three:[0,1],through:1,thumbnail:3,thumbnailurl:3,time:0,titl:3,tmp:3,tool:[0,1,3],topic:3,trigger:0,troop:3,trump:3,tuesdai:3,turner:3,tutori:2,tutorial2:3,tutorial3:3,tutorialtask:3,tweet:0,twitter:[0,1,3],twitter_access_token:3,twitter_access_token_secret:3,twitter_consumer_kei:3,twitter_consumer_secret:3,two:0,type:[0,1,3],ubuntu:3,uncov:0,understand:[0,1],unexpect:0,upm:3,url:[0,3],use:[0,3],used:0,useful:1,user:[0,1],uses:0,using:0,valid:0,valu:3,valuabl:0,variabl:3,vega:3,video:1,view:0,visit:[0,3],visual:[0,3],wai:[0,3],want:[1,3],web:[1,2,3],webpag:0,websit:0,wednesdai:3,well:0,what:[0,2],when:[0,3],where:0,whether:3,which:[0,1,3],whose:0,wish:3,within:0,work:0,workflow:[0,3],would:[0,3],write:3,www:3,yet:0,you:3,your:2,youraccesstoken:3,youraccesstokensecret:3,yourconsumerkei:3,yourconsumersecret:3,yourfusekiendpoint:3,yourfusekipass:3,yourmeaningcloudapikei:3,zone:3},titles:["Architecture","What is GSI Crawler?","Welcome to GSI Crawler’s documentation!","Getting started"],titleterms:{"new":3,app:0,architectur:0,compon:0,crawl:3,crawler:[1,2,3],dashboard:3,data:3,develop:3,document:2,enrich:3,first:3,get:3,glanc:3,gsi:[1,2,3],iii:3,instal:3,modul:0,overview:0,polym:0,semant:3,server:0,start:3,storag:3,task:0,tutori:3,web:0,welcom:2,what:1,your:3}})
\ No newline at end of file
Search.setIndex({docnames:["architecture","gsicrawler","index","tutorials"],envversion:51,filenames:["architecture.rst","gsicrawler.rst","index.rst","tutorials.rst"],objects:{},objnames:{},objtypes:{},terms:{"02t21":3,"03t14":3,"04t18":3,"26z":3,"29z":3,"30z":3,"36z":3,"55km":3,"case":[0,1,3],"class":[0,3],"default":0,"final":[1,3],"function":[0,1],"import":[0,3],"new":[0,1,2],"return":3,For:[0,3],Las:3,One:0,That:0,The:[0,1,3],Then:3,There:3,These:0,_id:3,_index:3,_score:3,_scrapi:3,_search:3,_sourc:3,_type:3,about:[1,3],abov:[0,3],acces:3,access:3,accord:[0,3],acquisit:0,activ:0,add:[],added:3,adding:[],address:3,administr:0,after:0,again:[],agil:0,aim:[0,1],align:3,all:[0,3],allow:[0,3],also:[0,3],ambush:3,analysi:[0,1],analyt:0,analyz:0,ani:0,anoth:0,apart:[0,3],api:[0,3],api_key_meaning_cloud:3,app:2,appear:3,applic:0,approach:[0,1],architectur:[1,2],argument:0,arm:3,articlebodi:3,assad:3,asset:3,attach:0,author:3,automat:0,aux:3,avail:[0,1,3],background:[],baghdadi:3,base:[0,3],bashar:3,becaus:0,been:0,befor:0,behav:0,being:[0,3],belong:0,below:0,better:[0,1],bodi:3,both:[0,3],browser:3,buffer:3,build:[0,3],call:[0,3],can:[0,3],capabl:0,carri:[0,1],categor:0,cdn:3,center:3,central:0,certain:0,certainti:0,chang:[],charg:3,chart:[],citi:3,clear:0,client:0,clone:3,cluster:3,cnn:3,cnnnext:3,code:3,collabor:0,collect:[0,3],color:[],com:3,comfort:0,comment:0,commonli:0,complex:3,compon:2,compos:3,concept:0,concert:3,conclud:0,conflict:3,consist:0,consol:3,contain:[0,3],content:[0,2,3],core:0,could:[0,3],crawl:2,crawler:0,crawlertask:3,creat:3,credenti:3,cron:0,dai:[],dam:3,dashboard:[0,2],data:[0,2],datemodifi:3,datepublish:3,datetim:0,def:3,defin:0,demo:[1,3],demodashboard:[],depend:3,describ:0,desir:0,detail:[0,1,3],develop:2,diagram:0,dict:3,did:3,differ:[0,3],directori:3,discov:[0,3],displai:0,distribut:0,dit:3,divid:0,doc:0,docker:3,document:[0,1,3],domest:3,donald:3,dump:3,each:[0,1,3],edit:[],elast:[0,3],elasticsearch:[0,3],element:3,emot:0,engin:0,enrich:[0,1,2],enter:3,entiti:3,env:3,environ:[0,3],es_endpoint:3,es_endpoint_extern:3,es_port:3,everydai:0,examin:1,exampl:[0,3],execut:3,exist:0,expect:0,explain:[0,1],explor:3,expos:1,extens:0,extract:[0,1,3],facilit:0,fast:0,fetch:0,field:3,figur:0,file:[0,3],filepath:3,filesystem:3,filter:0,find:3,finish:3,fire:3,first:2,firstpublishd:3,fit:0,focus:0,folder:[],follow:[0,1,3],forc:3,form:0,format:3,found:3,framework:[0,1],from:[0,1,3],fulful:0,fuseki:[0,3],fuseki_endpoint:3,fuseki_endpoint_extern:3,fuseki_password:3,fuseki_port:3,gather:3,gener:[0,3],geoloc:3,get:2,git:3,github:[],give:0,glanc:2,global:1,goe:[],going:[0,1,3],googl:[],group:0,grow:0,gsi:0,gsicrawl:3,has:[0,3],have:[0,3],hawija:3,headlin:3,heart:0,here:[1,3],high:0,hostil:3,how:[0,3],html:[0,3],http:[0,3],ico:[],icon:[],identif:3,iii:2,imag:[],imagin:0,incid:3,includ:0,incom:0,incurs:3,independ:0,index:[0,3],inform:[0,1,3],ingest:0,initi:3,innov:1,input:0,insid:0,instal:2,instanc:0,instruct:3,interact:[0,1],interfac:[0,1],intern:0,introduc:1,involv:0,iraq:3,iraqi:3,isi:3,its:[0,3],itself:1,jpg:3,json:[0,3],kill:3,known:0,lab:3,las:3,lastli:0,lastmodifiedd:3,later:0,latest:3,level:0,librari:[0,3],like:[],line:3,link:3,local:3,localhost:3,localtarget:3,log:3,luigi:[0,3],made:3,main:0,manag:0,mandatori:0,mani:[],mass:3,meaningcloud:3,method:0,middleeast:3,militari:3,mine:0,modul:[1,2],modular:0,moment:[0,1],more:[0,3],most:[0,1],multipl:0,mum:3,murder:3,must:[],name:[0,3],necessari:0,need:3,newsarticl:3,newsitem:3,next:3,niger:3,nomber:[],now:3,num:3,number:0,obtain:[0,3],offer:[0,3],onc:0,one:[0,3],onli:3,open:[0,3],oper:[0,3],option:[],orchest:0,order:[0,1,3],organ:0,origin:0,other:0,our:3,out:[0,1],outfil:3,output:3,overview:2,page:[1,3],paradigm:0,paramet:[0,3],pars:0,path:3,peopl:3,period:0,petit:0,piec:3,pipelin:[0,3],pipelinetask:3,place:[],platform:[0,1],pleas:[0,3],point:0,polit:3,polym:2,polymerel:[],possibl:[0,3],power:0,presid:3,pretti:3,previou:0,previous:0,print:3,process:[0,3],program:3,project:[1,3],provid:0,queri:0,quickest:3,recaptur:3,receiv:0,recogn:0,reddit:[0,1],refer:0,refresh:[],regim:3,relat:3,remot:0,repositori:3,repres:0,represent:0,request:[0,3],requir:[0,3],respons:[0,3],rest:0,result:[0,3],retriev:0,retrievecnnnew:3,root:3,run:[0,3],russia:3,sai:3,same:0,save:0,schema:3,scrape:[0,3],scraper:[0,3],scrapi:[0,3],search:[0,3],second:3,section:0,see:3,sefarad:[0,2],select:[0,1],self:3,semant:[0,1,2],senpi:[0,3],sent:0,sentenc:0,sentiment:[0,3],sequenc:0,server:2,servic:[0,3],set:[0,3],sever:0,shoot:3,should:3,show:[0,3],shown:0,simpl:0,simpli:0,size:3,solv:0,some:3,sourc:[0,3],spider:0,stack:0,start:2,step:[0,3],storag:[0,2],store:[0,3],stori:3,str:3,strign:0,structur:[0,3],studi:1,sub:0,submodul:0,success:3,sudo:3,surround:3,syria:3,syrian:3,system:[0,1],tag:0,take:0,tanf:3,target:3,task:[2,3],terror:3,text:0,thank:0,thei:3,thi:[0,1,3],third:0,those:3,three:[0,1],through:1,thumbnail:3,thumbnailurl:3,time:0,titl:[],tmp:3,tool:[0,1,3],topic:3,trigger:0,troop:3,trump:3,tuesdai:3,turner:3,tutori:2,tutorial2:3,tutorial3:3,tutorialtask:3,tweet:0,twitter:[0,1,3],twitter_access_token:3,twitter_access_token_secret:3,twitter_consumer_kei:3,twitter_consumer_secret:3,two:0,type:[0,1,3],ubuntu:3,uncov:0,understand:[0,1],unexpect:0,upm:3,url:[0,3],use:[0,3],used:0,useful:1,user:[0,1],uses:0,using:0,valid:0,valu:3,valuabl:0,variabl:3,vega:3,video:1,view:0,visit:[0,3],visual:[0,3],wai:[0,3],want:1,web:[1,2,3],webpag:0,websit:0,wednesdai:3,well:0,what:[0,2],when:[0,3],where:0,whether:3,which:[0,1,3],whose:0,wish:3,within:0,work:0,workflow:[0,3],would:[0,3],write:3,www:3,yet:0,you:3,your:3,youraccesstoken:3,youraccesstokensecret:3,yourconsumerkei:3,yourconsumersecret:3,yourfusekiendpoint:3,yourfusekipass:3,yourmeaningcloudapikei:3,zone:3},titles:["Architecture","What is GSI Crawler?","Welcome to GSI Crawler’s documentation!","Getting started"],titleterms:{"new":3,app:0,architectur:0,compon:0,crawl:3,crawler:[1,2,3],dashboard:3,data:3,develop:3,document:2,enrich:3,first:3,get:3,glanc:3,gsi:[1,2,3],iii:3,instal:3,modul:0,overview:0,polym:0,sefarad:3,semant:3,server:0,start:3,storag:3,task:0,tutori:3,web:0,welcom:2,what:1,your:[]}})
<h2>Tutorial IV: Developing your first dashboard<aclass="headerlink"href="#tutorial-iv-developing-your-first-dashboard"title="Permalink to this headline">¶</a></h2>
<p>In this section we will explain how to create a new dashboard for GSICrawler.
We have create the main structure inside demodashboard folder. Open a web browser and visit <codeclass="docutils literal"><spanclass="pre">localhost:8090</span></code> to explore this new dashboard.</p>
<p>As you can see there is a google-chart displaying how many news are created each day. To add new web components to your dashboard you have to edit dashboard-gsicrawler.html file inside demodashboard folder.</p>
<p>Search the line that says</p>
<divclass="highlight-html"><divclass="highlight"><pre><span></span><spanclass="cp"><!— YOUR NEW COMPONENTS GOES HERE —></span>
</pre></div>
</div>
<p>Below this line we are going to add a new web component, in this tutorial we are going to add a number-chart adding:</p>
<p>This icon must be stored inside images folder. Refresh your web browser to see your changes.</p>
<p>This web components has many more options like changing the background color, the title... For more information visit <aclass="reference external"href="https://lab.cluster.gsi.dit.upm.es/sefarad/number-chart">https://lab.cluster.gsi.dit.upm.es/sefarad/number-chart</a>.</p>
<p>You can add as Web Components as you want, there are some examples in <aclass="reference external"href="https://github.com/PolymerElements/">https://github.com/PolymerElements/</a></p>
<p>If you wish to discover more about how to create dashboards, please visit <aclass="reference external"href="http://sefarad.readthedocs.io/en/latest/">Sefarad documentation</a>.</p>
<h2>Developing Sefarad dashboards<aclass="headerlink"href="#developing-sefarad-dashboards"title="Permalink to this headline">¶</a></h2>
<p>If you wish to discover more about how to create dashboards, please visit <aclass="reference external"href="http://sefarad.readthedocs.io/en/latest/dashboard-dev">Sefarad documentation</a>.</p>
</div>
</div>
...
...
@@ -291,7 +267,7 @@ We have create the main structure inside demodashboard folder. Open a web browse
<liclass="toctree-l2"><aclass="reference internal"href="#tutorial-iii-semantic-enrichment-and-data-storage">Tutorial III: Semantic enrichment and data storage</a></li>
<liclass="toctree-l2"><aclass="reference internal"href="#tutorial-iv-developing-your-first-dashboard">Tutorial IV: Developing your first dashboard</a></li>
In this section we will explain how to create a new dashboard for GSICrawler.
We have create the main structure inside demodashboard folder. Open a web browser and visit ``localhost:8090`` to explore this new dashboard.
As you can see there is a google-chart displaying how many news are created each day. To add new web components to your dashboard you have to edit dashboard-gsicrawler.html file inside demodashboard folder.
Search the line that says
.. sourcecode:: html
<!— YOUR NEW COMPONENTS GOES HERE —>
Below this line we are going to add a new web component, in this tutorial we are going to add a number-chart adding:
.. sourcecode:: html
<number-chart></number-chart>
Refresh your web browser and you will see your new number-chart component, but with no data. To add your data change the line added before:
.. sourcecode:: html
<number-chart data="{{data}}"></number-chart>
Refresh your web browser again to see your data. As you can see it has a place for an icon, we can add it typing:
This icon must be stored inside images folder. Refresh your web browser to see your changes.
This web components has many more options like changing the background color, the title... For more information visit https://lab.cluster.gsi.dit.upm.es/sefarad/number-chart.
You can add as Web Components as you want, there are some examples in https://github.com/PolymerElements/
Developing Sefarad dashboards
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
If you wish to discover more about how to create dashboards, please visit `Sefarad documentation <http://sefarad.readthedocs.io/en/latest/>`_.
\ No newline at end of file
If you wish to discover more about how to create dashboards, please visit `Sefarad documentation <http://sefarad.readthedocs.io/en/latest/dashboard-dev>`_.
