You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-20 - 08:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Fri Sep 20, 2024 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
123832210260,13sleep20-21swapper/219:09:212
12632121010,7sleep10-21swapper/119:15:061
12384629367,18sleep30-21swapper/319:09:303
12382429066,16sleep00-21swapper/019:09:140
1613362890,4sleep20-21swapper/220:50:122
12380928965,17sleep10-21swapper/119:09:021
2340402860,4sleep20-21swapper/200:10:032
1305892760,4sleep10-21swapper/119:25:201
12404299752,17cyclictest0-21swapper/323:55:583
1675232740,4sleep10-21swapper/121:05:261
2396072730,4sleep20-21swapper/200:25:122
12404299706,8cyclictest141rcu_preempt20:57:593
124042996911,8cyclictest141rcu_preempt23:54:583
12403599681,29cyclictest0-21swapper/223:16:282
12404299664,7cyclictest141rcu_preempt20:02:593
162399630,4rtkit-daemon0-21swapper/022:57:110
124035996321,7cyclictest0-21swapper/222:14:582
162399620,10rtkit-daemon1622-21rtkit-daemon21:40:071
124035996225,10cyclictest34-21ksoftirqd/200:32:592
124035996220,7cyclictest0-21swapper/221:11:582
162399600,9rtkit-daemon1622-21rtkit-daemon20:54:370
124032996016,14cyclictest3679282-21firefox21:35:571
162399590,9rtkit-daemon1622-21rtkit-daemon21:38:220
12402999591,53cyclictest1753-21gnome-shell22:21:580
162399580,9rtkit-daemon1622-21rtkit-daemon23:05:500
162399580,9rtkit-daemon1622-21rtkit-daemon23:02:140
162399580,8rtkit-daemon1622-21rtkit-daemon21:58:010
12403599582,15cyclictest1753-21gnome-shell23:44:592
12402999581,52cyclictest1753-21gnome-shell22:17:580
162399570,9rtkit-daemon1622-21rtkit-daemon21:51:490
162399570,8rtkit-daemon1622-21rtkit-daemon23:40:000
162399570,8rtkit-daemon1622-21rtkit-daemon21:00:310
12402999572,51cyclictest1753-21gnome-shell00:09:580
162399560,9rtkit-daemon1622-21rtkit-daemon23:43:490
12404299562,49cyclictest151595-21StreamT~s3
124032995635,17cyclictest1753-21gnome-shell21:59:591
12403299562,50cyclictest144469-21kworker/1:221:30:581
124032995619,14cyclictest150675-21memory20:20:231
124032995617,12cyclictest438-20systemd-journal21:53:071
124032995616,11cyclictest225107-21cat23:45:201
124032995521,10cyclictest200922-21date22:40:021
124032995521,10cyclictest200922-21date22:40:021
124032995518,9cyclictest173707-21ls21:25:011
124032995517,12cyclictest203433-21cat22:45:231
12402999558,40cyclictest1753-21gnome-shell20:56:580
12402999551,11cyclictest1753-21gnome-shell20:31:580
2108522540,6chrt0-21swapper/223:05:352
162399540,9rtkit-daemon1622-21rtkit-daemon21:32:330
12404299542,11cyclictest214729-21StreamT~s3
124035995438,12cyclictest1753-21gnome-shell23:49:592
12403599542,10cyclictest1753-21gnome-shell23:52:582
124032995420,12cyclictest205297-21ntpq22:50:251
124032995419,11cyclictest237655-21date00:20:021
12403299541,49cyclictest26-21ksoftirqd/119:10:591
12402999542,10cyclictest1753-21gnome-shell19:38:580
12404299531,48cyclictest1753-21gnome-shell19:15:583
12403599532,10cyclictest1753-21gnome-shell19:16:592
12403299535,8cyclictest231irq_work/120:36:591
12403299533,46cyclictest231irq_work/119:30:581
12403299532,10cyclictest144469-21kworker/1:221:48:581
12403299532,10cyclictest144469-21kworker/1:221:48:581
124032995319,11cyclictest145121-21basename20:05:181
124032995317,10cyclictest191680-21seq22:14:101
12403299531,47cyclictest1753-21gnome-shell20:51:581
124032995313,12cyclictest438-20systemd-journal22:40:001
12403299531,10cyclictest1753-21gnome-shell22:01:591
12402999532,47cyclictest1753-21gnome-shell23:27:590
12402999531,48cyclictest1753-21gnome-shell00:34:580
1961282520,14sleep1261ksoftirqd/122:25:231
124035995219,28cyclictest220430-21munin-run23:35:002
124032995242,7cyclictest26-21ksoftirqd/123:38:581
12403299522,7cyclictest0-21swapper/123:59:581
12403299522,46cyclictest233445-21taskset00:08:581
124032995217,12cyclictest192116-21cat22:15:131
124032995217,11cyclictest141551-21basename19:55:241
124032995215,11cyclictest198046-21needreboot22:30:241
12403299521,46cyclictest1753-21gnome-shell22:56:591
12402999522,46cyclictest1753-21gnome-shell20:25:590
12402999522,46cyclictest1753-21gnome-shell20:25:580
12402999522,45cyclictest1753-21gnome-shell23:16:370
12402999521,47cyclictest1753-21gnome-shell20:11:580
124042995133,14cyclictest1753-21gnome-shell22:42:593
124042995133,14cyclictest1753-21gnome-shell22:42:583
124032995141,7cyclictest26-21ksoftirqd/119:47:591
12403299513,45cyclictest231irq_work/120:41:591
12403299512,45cyclictest231irq_work/123:30:581
12403299512,45cyclictest1753-21gnome-shell20:14:591
124032995116,10cyclictest165195-21ls21:00:121
124029995125,7cyclictest141rcu_preempt22:31:580
12402999512,45cyclictest144408-21StreamT~s0
12402999511,46cyclictest1753-21gnome-shell21:48:590
12402999511,46cyclictest1753-21gnome-shell21:48:590
12402999511,22cyclictest141rcu_preempt20:23:590
12404299502,5cyclictest0-21swapper/321:20:593
124042995023,23cyclictest157302-21unin-run20:40:003
124032995042,5cyclictest26-21ksoftirqd/122:07:591
124032995040,7cyclictest26-21ksoftirqd/121:16:591
124032995038,8cyclictest1753-21gnome-shell23:20:591
12403299502,8cyclictest231irq_work/123:29:581
12403299502,7cyclictest0-21swapper/100:01:581
12403299502,7cyclictest0-21swapper/100:01:581
12403299502,44cyclictest0-21swapper/123:12:581
12403299502,44cyclictest0-21swapper/119:20:591
124032995010,13cyclictest242467-21DNS1
12402999502,44cyclictest1753-21gnome-shell00:12:580
12402999501,31cyclictest141rcu_preempt21:09:580
12403599491,5cyclictest0-21swapper/221:23:582
124032994940,6cyclictest231irq_work/120:02:581
124032994931,14cyclictest1753-21gnome-shell23:01:581
12403299492,7cyclictest0-21swapper/120:15:591
12403299492,7cyclictest0-21swapper/100:19:591
12403299492,6cyclictest0-21swapper/119:51:591
12403299492,43cyclictest0-21swapper/100:12:591
124032994922,7cyclictest240988-21idleruntime-cro00:29:591
124032994919,6cyclictest163102-21update-motd-upd20:55:021
124032994915,11cyclictest213657-21sort23:15:131
124032994913,12cyclictest438-20systemd-journal20:45:201
124032994913,10cyclictest222814-21expr23:40:131
124029994938,7cyclictest1753-21gnome-shell20:15:580
12402999493,39cyclictest1753-21gnome-shell20:35:580
12402999491,31cyclictest141rcu_preempt22:13:590
124042994831,13cyclictest855-21dbus-daemon23:21:033
12404299482,6cyclictest0-21swapper/323:43:583
12404299482,6cyclictest0-21swapper/322:28:583
12403599484,39cyclictest1753-21gnome-shell19:12:592
124032994831,13cyclictest1753-21gnome-shell19:36:581
12403299482,6cyclictest0-21swapper/123:07:581
12403299482,43cyclictest0-21swapper/122:24:581
124032994815,11cyclictest154623-40lsb_release20:30:221
124032994812,11cyclictest174784-21switchtime21:25:281
12403299481,10cyclictest1753-21gnome-shell21:11:591
2209662470,4chrt0-21swapper/223:35:132
162399470,22rtkit-daemon0-21swapper/019:13:140
124042994721,8cyclictest42-21ksoftirqd/319:47:223
12403599472,42cyclictest0-21swapper/222:22:592
12403299479,13cyclictest438-20systemd-journal19:41:331
12402999477,29cyclictest1753-21gnome-shell21:18:590
124029994720,23cyclictest231056-40lsb_release00:00:280
124029994720,23cyclictest231056-40lsb_release00:00:270
12404299464,36cyclictest1753-21gnome-shell22:30:583
12404299462,5cyclictest0-21swapper/323:11:583
12404299462,5cyclictest0-21swapper/300:15:583
12404299462,5cyclictest0-21swapper/300:11:583
12404299462,42cyclictest0-21swapper/322:38:593
12404299460,44cyclictest0-21swapper/320:19:583
12403599462,41cyclictest0-21swapper/220:31:592
12403599462,41cyclictest0-21swapper/200:21:582
124032994639,5cyclictest26-21ksoftirqd/120:28:581
124032994639,5cyclictest26-21ksoftirqd/120:28:581
124032994638,5cyclictest1358-1kworker/u9:123:54:591
124029994639,4cyclictest0-21swapper/019:34:590
124029994634,8cyclictest1753-21gnome-shell22:07:590
12402999463,38cyclictest1753-21gnome-shell19:45:580
12402999462,42cyclictest0-21swapper/023:21:580
12402999462,42cyclictest0-21swapper/019:53:590
12402999461,29cyclictest141rcu_preempt19:55:590
124042994539,4cyclictest0-21swapper/321:15:593
12404299452,41cyclictest0-21swapper/322:48:583
12404299452,41cyclictest0-21swapper/321:30:583
12404299452,41cyclictest0-21swapper/321:02:583
12404299452,41cyclictest0-21swapper/320:40:583
12404299452,41cyclictest0-21swapper/319:32:593
124035994524,6cyclictest0-21swapper/200:38:592
12403599452,41cyclictest0-21swapper/220:19:582
12403599452,40cyclictest0-21swapper/200:06:592
124029994535,7cyclictest1753-21gnome-shell21:26:580
124029994531,10cyclictest884-21gdbus22:40:410
124029994531,10cyclictest884-21gdbus22:40:400
2045652440,4sleep30-21swapper/322:50:113
1830412440,9sleep2182976-21StreamT~s2
1830412440,9sleep2182976-21StreamT~s2
124042994438,4cyclictest0-21swapper/323:31:593
124042994438,4cyclictest0-21swapper/321:27:593
124042994438,4cyclictest0-21swapper/321:08:583
124042994438,4cyclictest0-21swapper/300:08:583
12404299442,40cyclictest0-21swapper/319:42:583
12404299442,40cyclictest0-21swapper/319:37:593
124042994420,6cyclictest178982-21apt-get21:40:023
124035994438,4cyclictest0-21swapper/219:24:582
12403599442,40cyclictest0-21swapper/219:38:592
124029994423,16cyclictest1753-21gnome-shell20:09:580
12402999441,5cyclictest141rcu_preempt21:11:590
12402999441,5cyclictest141rcu_preempt00:38:580
124042994337,4cyclictest0-21swapper/319:52:583
124042994325,14cyclictest230249-40apt-check00:00:143
124042994325,14cyclictest230249-40apt-check00:00:143
124042994323,15cyclictest239842-21df00:25:153
124042994313,18cyclictest141rcu_preempt22:55:173
124035994337,4cyclictest0-21swapper/220:12:592
124029994337,4cyclictest0-21swapper/021:22:590
12404299422,20cyclictest0-21swapper/322:13:593
124035994236,4cyclictest0-21swapper/221:34:592
124035994236,4cyclictest0-21swapper/220:04:582
124029994226,11cyclictest1753-21gnome-shell21:44:590
124029994224,14cyclictest203874-21users22:45:310
12402999422,34cyclictest3679282-21firefox23:59:590
1609182410,5chrt0-21swapper/320:50:023
12404299418,11cyclictest141rcu_preempt20:12:123
124042994135,4cyclictest0-21swapper/321:50:593
124042994125,12cyclictest855-21dbus-daemon21:40:003
124042994116,7cyclictest141rcu_preempt19:20:123
124042994113,6cyclictest141rcu_preempt23:01:443
124035994130,8cyclictest153501-21kworker/2:121:06:592
124035994124,13cyclictest859-21NetworkManager23:58:052
124029994127,10cyclictest1753-21gnome-shell22:39:590
124029994123,6cyclictest13-21ksoftirqd/000:25:150
12404299408,11cyclictest141rcu_preempt20:10:003
124042994024,12cyclictest2962348-21rs:main3
124035994033,4cyclictest0-21swapper/223:27:582
124035994033,4cyclictest0-21swapper/221:38:582
124035994033,4cyclictest0-21swapper/220:25:592
124035994033,4cyclictest0-21swapper/220:25:582
124035994022,13cyclictest438-20systemd-journal20:09:222
124035994021,14cyclictest2962348-21rs:main2
124032994034,4cyclictest0-21swapper/100:36:581
124029994034,4cyclictest0-21swapper/020:43:580
162399390,32rtkit-daemon0-21swapper/023:10:570
124042993933,4cyclictest0-21swapper/323:36:593
124042993926,8cyclictest193492-21DNS3
124042993923,12cyclictest211466-21cron23:10:003
124042993923,11cyclictest239199-21cron00:25:003
124042993922,13cyclictest859-21NetworkManager19:11:083
124042993922,13cyclictest154656-21ntp_kernel_err20:30:233
124042993920,15cyclictest185283-21df_inode21:55:203
124042993920,14cyclictest225653-31apt-check23:45:293
124042993910,6cyclictest141rcu_preempt21:15:003
124035993933,4cyclictest0-21swapper/222:17:582
124035993933,4cyclictest0-21swapper/221:58:592
124035993924,11cyclictest181074-21sh21:45:002
124035993921,12cyclictest3679629-21Web14:31:442
124035993916,19cyclictest197110-21cron22:30:012
124029993933,4cyclictest0-21swapper/023:30:590
124029993924,10cyclictest1753-21gnome-shell20:47:590
124029993924,10cyclictest1753-21gnome-shell19:43:580
162399380,30rtkit-daemon0-21swapper/022:04:240
12404299389,6cyclictest141rcu_preempt22:25:003
124042993818,15cyclictest3679461-21IPC3
12404299381,32cyclictest1753-21gnome-shell19:25:593
124035993825,8cyclictest908-21gdbus21:17:022
12403599382,32cyclictest164464-40lsb_release20:57:272
124035993820,14cyclictest204808-21cat22:50:132
12403599381,32cyclictest1753-21gnome-shell19:28:582
124029993823,11cyclictest227227-21python323:50:280
12402999382,18cyclictest236656-21ntp_states00:15:250
124042993718,14cyclictest3679661-21Timer21:45:433
124042993718,14cyclictest3679661-21Timer21:45:433
12404299371,32cyclictest243429-21diskstats00:35:173
124035993725,8cyclictest1897938-21snapd22:36:472
124035993720,12cyclictest438-20systemd-journal19:46:352
124035993720,12cyclictest189711-21StreamT~s2
12402999371,32cyclictest225427-40lsb_release23:45:260
124042993621,11cyclictest141440-21expr19:55:193
124042993620,12cyclictest161490-21df20:50:153
124042993619,13cyclictest186764-21cat22:00:123
124035993629,5cyclictest0-21swapper/219:59:582
124035993628,5cyclictest0-21swapper/222:40:582
124035993628,5cyclictest0-21swapper/222:40:572
124035993623,8cyclictest3679282-21firefox20:45:332
124035993621,11cyclictest208521-21forks23:00:182
124035993620,12cyclictest187315-21cat22:00:222
124035993620,12cyclictest183525-21hddtemp_smartct21:50:222
124035993620,11cyclictest140635-21StreamT~s2
124035993618,13cyclictest145881-21BgIOThr~ool2
124035993617,13cyclictest3679461-21IPC2
12402999364,29cyclictest181irq_work/022:51:580
124029993619,13cyclictest129063-21awk19:20:260
12404299351,15cyclictest189557-21users22:05:313
124035993529,4cyclictest0-21swapper/222:34:582
124035993521,9cyclictest3679588-21Privileged14:31:442
124035993520,11cyclictest165624-21sed21:00:212
124035993519,12cyclictest231340-21users00:00:312
124035993519,12cyclictest231340-21users00:00:312
12402999355,6cyclictest1271881needreboot19:15:210
124029993522,8cyclictest3679282-21firefox19:29:340
124029993520,11cyclictest237663-21seq00:20:080
12404299342,17cyclictest152246-21df20:25:153
12404299342,17cyclictest152246-21df20:25:153
124035993419,11cyclictest207164-21cut22:55:252
124035993418,12cyclictest212780-21expr23:10:322
124035993415,15cyclictest3679488-21TaskCon~ller2
12402999342,29cyclictest0-21swapper/022:26:000
124035993326,4cyclictest0-21swapper/220:40:142
124035993316,12cyclictest3680327-21Web14:31:442
124035993315,13cyclictest3680291-21Web14:31:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional