CIDuty/How To/High Pending Counts: Difference between revisions

Line 65: Line 65:
=== Are ssh keys are problem on the the masters? ===
=== Are ssh keys are problem on the the masters? ===
Buildbot ssh keys have a problem {{bug|1198332}}
Buildbot ssh keys have a problem {{bug|1198332}}
=== Cannot connect to AWS due to network issues ===
Chaos really. We heavily depend on AWS.


=== Are there problems connecting to the Buildbot database? ===
=== Are there problems connecting to the Buildbot database? ===
Cannot connect to database due to network or other issues. Pending count will probably not increase, will just stay the same because jobs aren't deleted from db as they complete.  
Cannot connect to database due to network or other issues. Pending count will probably not increase, will just stay the same because jobs aren't deleted from db as they complete.  


=== Cannot connect to AWS due to network issues ===
=== Are jobs taking longer today than they did yesterday ===
Chaos really. We heavily depend on AWS.
 
Check end to end times here https://www.hostedgraphite.com/da5c920d/86a8384e-d9cf-4208-989b-9538a1a53e4b/grafana/#/dashboard/db/kpis


== What code/systems have changed? ==
== What code/systems have changed? ==
Confirmed users
1,989

edits