You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 21:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Sep 22, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1435721010,4sleep014356-21tr10:40:310
17920998830,51cyclictest13672-21sensors08:10:533
17920998736,33cyclictest22075-21hwlatdetect07:35:443
17920998333,43cyclictest0-21swapper/306:45:473
17920998333,42cyclictest3132-21diskstats05:55:463
17920998330,45cyclictest0-21swapper/308:01:453
311912820,5sleep331276-21cut05:45:543
17920998224,41cyclictest0-21swapper/307:45:423
17920998135,27cyclictest15990-21ssh07:26:003
17920998134,30cyclictest21590-21sshd09:11:573
17920998133,19cyclictest18511-21gltestperf07:30:453
17920998131,30cyclictest0-21swapper/309:51:153
17920998130,42cyclictest0-21swapper/309:00:423
17920998130,42cyclictest0-21swapper/309:00:423
89162800,8sleep01791699cyclictest07:15:390
17920998035,24cyclictest24822-21ssh07:40:413
17920998035,24cyclictest24822-21ssh07:40:413
17920998033,40cyclictest20854-21ssh08:21:403
17920998033,40cyclictest20854-21ssh08:21:403
17920998031,41cyclictest1124-21snmpd07:59:183
17920998030,29cyclictest68671munin-node09:40:313
17920998030,29cyclictest68671munin-node09:40:313
17920998027,46cyclictest0-21swapper/310:24:593
17920998027,46cyclictest0-21swapper/310:24:593
17920997928,44cyclictest0-21swapper/308:49:303
17920997924,29cyclictest24201-21runrttasks08:26:543
17920997834,37cyclictest1227-21runrttasks09:28:503
17920997833,26cyclictest10479-21sh10:35:173
17920997831,40cyclictest0-21swapper/308:57:213
17920997829,42cyclictest12436-21runrttasks09:47:273
17920997829,33cyclictest0-21swapper/310:40:513
17920997828,43cyclictest0-21swapper/309:34:033
17920997828,43cyclictest0-21swapper/309:05:323
17920997828,32cyclictest0-21swapper/310:03:313
17920997826,44cyclictest4581-21gltestperf07:05:463
17920997826,44cyclictest4581-21gltestperf07:05:463
17920997824,48cyclictest0-21swapper/308:31:503
17920997736,23cyclictest9326-21df08:05:403
17920997733,37cyclictest26045-21telnet09:20:303
17920997732,38cyclictest0-21swapper/308:20:213
17920997730,40cyclictest31213-21munin-node06:55:493
17920997730,40cyclictest0-21swapper/310:48:423
17920997730,31cyclictest0-21swapper/309:55:513
17920997729,39cyclictest0-21swapper/308:40:413
17920997729,32cyclictest0-21swapper/310:25:393
17920997729,27cyclictest0-21swapper/310:05:373
17920997726,43cyclictest0-21swapper/309:35:443
17920997636,32cyclictest1227-21runrttasks06:50:383
17920997635,33cyclictest29097-21df08:35:373
17920997632,37cyclictest31125-21needreboot10:15:443
17920997630,31cyclictest0-21swapper/305:26:003
17920997626,42cyclictest0-21swapper/308:51:113
17920997625,44cyclictest12934-21tail06:15:483
17920997622,35cyclictest0-21swapper/310:35:313
17920997531,35cyclictest31661-21cstates07:50:373
17920997531,35cyclictest10655-21diskmemload07:23:003
17920997528,31cyclictest0-21swapper/309:15:473
17920997525,30cyclictest0-21swapper/306:30:423
17920997522,45cyclictest0-21swapper/306:35:433
17920997430,26cyclictest21171-1kworker/3:2H05:35:583
17920997427,21cyclictest0-21swapper/306:26:313
17920997426,40cyclictest0-21swapper/306:05:453
17920997425,39cyclictest1227-21runrttasks05:54:563
17920997331,35cyclictest0-21swapper/310:14:313
17920997326,39cyclictest0-21swapper/306:10:513
17920997229,35cyclictest0-21swapper/307:15:473
17920997139,26cyclictest1227-21runrttasks05:40:573
17920997139,26cyclictest1227-21runrttasks05:40:573
17920997127,24cyclictest5943-21awk06:00:503
17920997126,30cyclictest14606-21telnet06:20:413
17920997126,30cyclictest14606-21telnet06:20:413
1791899713,59cyclictest0-21swapper/110:15:341
17920997022,31cyclictest0-21swapper/305:20:413
17920996822,29cyclictest0-21swapper/306:41:033
17920996820,41cyclictest0-21swapper/307:03:453
1791999684,55cyclictest0-21swapper/207:20:412
17920996732,28cyclictest1227-21runrttasks05:33:433
1791999664,28cyclictest0-21swapper/210:20:242
1791999664,28cyclictest0-21swapper/210:20:242
1791899664,56cyclictest0-21swapper/110:40:591
1791899663,57cyclictest0-21swapper/108:02:171
1791999654,53cyclictest0-21swapper/210:40:292
301122643,12sleep20-21swapper/208:35:522
1791999644,54cyclictest0-21swapper/209:00:442
1791999644,54cyclictest0-21swapper/209:00:442
1791899644,53cyclictest10612-21sed08:55:451
1791899643,55cyclictest0-21swapper/108:19:291
17920996328,20cyclictest0-21swapper/307:10:543
1791999634,52cyclictest0-21swapper/208:25:442
1791999634,52cyclictest0-21swapper/207:55:452
1791999634,51cyclictest0-21swapper/209:54:082
1791999634,51cyclictest0-21swapper/208:55:442
1791999634,51cyclictest0-21swapper/207:50:452
1791999634,51cyclictest0-21swapper/207:30:452
1791899634,13cyclictest0-21swapper/110:35:471
160252636,11sleep00-21swapper/009:53:390
219499620,4rtkit-daemon0-21swapper/307:49:322
1791999624,51cyclictest0-21swapper/210:15:462
1791999624,14cyclictest0-21swapper/208:10:432
1791899624,52cyclictest0-21swapper/107:59:371
1791899624,51cyclictest83782sleep109:40:501
1791899624,51cyclictest83782sleep109:40:501
61032613,50sleep10-21swapper/110:26:061
1791999619,46cyclictest21125-21latency10:00:452
1791999614,49cyclictest0-21swapper/210:25:412
1791999614,12cyclictest0-21swapper/210:40:182
1791999613,51cyclictest16993-21grep09:05:392
1791899614,51cyclictest0-21swapper/109:03:351
1791899614,51cyclictest0-21swapper/109:03:351
1791899613,52cyclictest0-21swapper/107:29:541
17916996127,12cyclictest0-21swapper/008:30:220
171462618,14sleep30-21swapper/305:15:563
219499600,6rtkit-daemon0-21swapper/309:40:282
219499600,6rtkit-daemon0-21swapper/309:40:282
203932603,8sleep020541-21grep08:20:590
203932603,8sleep020541-21grep08:20:590
1791999604,48cyclictest0-21swapper/208:00:392
1791999604,38cyclictest0-21swapper/208:08:142
17919996021,13cyclictest0-21swapper/208:24:072
17919996021,13cyclictest0-21swapper/208:24:072
17919996013,11cyclictest0-21swapper/209:17:382
1791899603,51cyclictest0-21swapper/108:40:381
1791899603,51cyclictest0-21swapper/105:55:051
1791899603,50cyclictest20984-21hwlatdetect10:00:421
83852593,49sleep10-21swapper/108:51:561
182622593,12sleep20-21swapper/210:45:382
1791999594,47cyclictest32230-21munin-run05:50:282
1791999594,15cyclictest0-21swapper/207:26:172
1791999593,50cyclictest0-21swapper/205:40:562
1791999593,50cyclictest0-21swapper/205:40:562
17919995912,27cyclictest0-21swapper/209:35:352
1791899594,49cyclictest0-21swapper/109:35:391
17918995924,28cyclictest18436-21wc09:55:531
17918995920,15cyclictest0-21swapper/109:15:331
219499580,6rtkit-daemon0-21swapper/308:43:232
219499580,6rtkit-daemon0-21swapper/305:56:292
1791999588,28cyclictest0-21swapper/209:13:502
17919995838,13cyclictest3261-21grep08:45:342
17919995823,15cyclictest0-21swapper/210:30:462
1791899585,48cyclictest0-21swapper/108:07:321
1791899585,27cyclictest0-21swapper/109:45:491
1791899584,48cyclictest0-21swapper/110:30:381
1791899584,48cyclictest0-21swapper/107:30:511
1791899584,47cyclictest0-21swapper/106:10:411
1791899584,46cyclictest0-21swapper/108:20:381
1791899584,46cyclictest0-21swapper/108:20:381
1791899584,28cyclictest0-21swapper/109:05:311
1791899583,8cyclictest107550irq/46-eth008:14:291
17916995842,8cyclictest12320-21ssh08:10:350
195612573,47sleep10-21swapper/110:47:221
1791999574,36cyclictest0-21swapper/209:49:012
1791999574,35cyclictest0-21swapper/207:36:052
1791899576,44cyclictest0-21swapper/107:20:261
1791899574,14cyclictest0-21swapper/110:20:531
1791899574,14cyclictest0-21swapper/110:20:531
1791899573,48cyclictest0-21swapper/109:26:581
1791899573,48cyclictest0-21swapper/109:15:221
1791899573,47cyclictest0-21swapper/107:03:271
1791699573,18cyclictest10655-21diskmemload08:45:400
14722572,9sleep00-21swapper/008:41:150
145722573,46sleep00-21swapper/006:20:410
145722573,46sleep00-21swapper/006:20:410
1791999565,32cyclictest0-21swapper/206:45:412
1791999565,30cyclictest0-21swapper/210:10:352
1791999564,31cyclictest0-21swapper/209:55:522
1791999564,31cyclictest0-21swapper/206:05:472
1791899564,47cyclictest0-21swapper/106:05:481
1791899564,45cyclictest0-21swapper/106:55:381
1791899563,47cyclictest0-21swapper/109:24:031
1791899563,47cyclictest0-21swapper/108:30:521
17918995628,12cyclictest0-21swapper/108:25:391
1791699563,46cyclictest0-21swapper/008:08:190
17916995619,31cyclictest32559-21netstat07:50:490
1791999555,31cyclictest0-21swapper/207:05:532
1791999555,31cyclictest0-21swapper/207:05:532
1791999555,30cyclictest0-21swapper/207:00:402
1791999553,35cyclictest0-21swapper/209:24:522
17919995510,26cyclictest0-21swapper/209:30:502
1791899555,44cyclictest0-21swapper/105:40:401
1791899555,44cyclictest0-21swapper/105:40:401
1791899555,43cyclictest1031-21gltestperf09:30:391
1791899554,46cyclictest0-21swapper/107:49:321
1791899554,45cyclictest0-21swapper/106:30:451
1791899553,46cyclictest0-21swapper/106:00:401
17918995527,13cyclictest0-21swapper/110:10:231
17916995538,10cyclictest32670-21aten_r1power_fr09:30:320
1791699553,24cyclictest0-21swapper/008:39:350
165442553,44sleep016690-21ssh09:55:210
1791999546,29cyclictest0-21swapper/210:05:342
1791999544,31cyclictest0-21swapper/206:35:492
1791999544,27cyclictest0-21swapper/209:30:192
1791999543,29cyclictest0-21swapper/207:40:382
1791999543,29cyclictest0-21swapper/207:40:382
1791999543,25cyclictest0-21swapper/205:25:422
17919995420,15cyclictest0-21swapper/208:15:532
1791999542,47cyclictest0-21swapper/205:35:512
17919995414,11cyclictest107550irq/46-eth007:10:392
1791899544,45cyclictest0-21swapper/109:50:401
1791899544,45cyclictest0-21swapper/107:35:411
1791899544,44cyclictest0-21swapper/107:16:001
1791899544,44cyclictest0-21swapper/106:25:381
1791899544,32cyclictest0-21swapper/110:05:521
1791899543,46cyclictest0-21swapper/107:54:341
1791899543,45cyclictest0-21swapper/108:47:101
1791899543,45cyclictest0-21swapper/105:57:181
1791899543,28cyclictest0-21swapper/107:40:431
1791899543,28cyclictest0-21swapper/107:40:431
1791699544,20cyclictest11313-21grep08:55:550
17916995435,13cyclictest0-21swapper/010:10:430
17916995434,14cyclictest0-21swapper/009:35:480
17916995434,13cyclictest0-21swapper/007:55:480
17916995432,8cyclictest24360-21ssh10:05:420
1791699543,45cyclictest24942-21cstates07:40:420
1791699543,45cyclictest24942-21cstates07:40:420
229072532,10sleep00-21swapper/005:30:390
185632532,9sleep00-21swapper/009:08:040
1791999535,30cyclictest0-21swapper/208:31:242
1791999535,30cyclictest0-21swapper/206:25:502
1791999535,29cyclictest0-21swapper/206:15:512
1791999534,31cyclictest0-21swapper/206:00:522
1791899534,44cyclictest0-21swapper/108:37:091
1791899534,43cyclictest0-21swapper/105:49:421
1791699534,42cyclictest0-21swapper/010:45:380
1791699533,43cyclictest0-21swapper/010:30:170
17916995326,13cyclictest0-21swapper/009:10:350
318302522,9sleep00-21swapper/009:28:280
1791999529,25cyclictest0-21swapper/208:53:052
1791999524,30cyclictest0-21swapper/206:55:532
1791999524,13cyclictest0-21swapper/206:54:232
1791999523,41cyclictest0-21swapper/206:20:582
1791999523,41cyclictest0-21swapper/206:20:582
1791699524,40cyclictest0-21swapper/009:45:340
17916995232,13cyclictest0-21swapper/009:00:380
17916995232,13cyclictest0-21swapper/009:00:380
1791699523,43cyclictest0-21swapper/010:21:140
1791699523,43cyclictest0-21swapper/010:21:140
1791699523,43cyclictest0-21swapper/008:19:260
1791699523,42cyclictest0-21swapper/007:45:430
17916995224,13cyclictest0-21swapper/010:30:490
73092512,42sleep00-21swapper/007:10:520
187112512,42sleep00-21swapper/006:26:060
1791999514,29cyclictest0-21swapper/207:15:352
1791999514,29cyclictest0-21swapper/205:35:292
1791999514,29cyclictest0-21swapper/205:20:582
1791899513,42cyclictest0-21swapper/105:25:461
17918995117,14cyclictest0-21swapper/107:09:251
17918995117,14cyclictest0-21swapper/107:09:251
1791699514,41cyclictest0-21swapper/010:15:530
17916995132,13cyclictest0-21swapper/008:00:380
1791699513,43cyclictest0-21swapper/007:32:020
1791699513,42cyclictest0-21swapper/008:53:120
1791699513,13cyclictest0-21swapper/009:19:070
17916995125,8cyclictest27448-21latency_hist05:40:290
17916995124,12cyclictest0-21swapper/007:25:400
273332503,41sleep10-21swapper/105:39:071
236742502,9sleep00-21swapper/006:38:350
1791999504,29cyclictest0-21swapper/205:50:382
1791999502,42cyclictest0-21swapper/206:35:282
1791699504,39cyclictest0-21swapper/010:00:350
1791699503,41cyclictest0-21swapper/007:35:550
17916995029,14cyclictest0-21swapper/006:46:000
17916995028,10cyclictest0-21swapper/008:31:220
17916995023,12cyclictest0-21swapper/009:41:370
17916995023,12cyclictest0-21swapper/009:41:370
130492502,42sleep00-21swapper/007:22:170
223512492,9sleep00-21swapper/005:26:240
1791999495,29cyclictest0-21swapper/206:44:212
1791999495,27cyclictest0-21swapper/206:14:152
1791899494,13cyclictest0-21swapper/106:20:591
1791899494,13cyclictest0-21swapper/106:20:591
1791899493,39cyclictest0-21swapper/105:20:421
1791899493,38cyclictest0-21swapper/106:50:381
1791699494,39cyclictest0-21swapper/009:20:470
1791699494,38cyclictest0-21swapper/010:37:080
55882482,39sleep00-21swapper/007:06:570
55882482,39sleep00-21swapper/007:06:570
317752482,38sleep00-21swapper/005:46:030
248642483,39sleep10-21swapper/105:33:021
1791899483,38cyclictest0-21swapper/106:45:381
17916994834,9cyclictest2734-21find07:00:560
1791699483,37cyclictest19821-21df06:30:410
141032482,9sleep00-21swapper/006:18:200
296532472,40sleep00-21swapper/005:43:130
296532472,40sleep00-21swapper/005:43:130
1791999473,25cyclictest0-21swapper/205:20:292
1791899473,37cyclictest0-21swapper/106:35:371
1791899473,36cyclictest0-21swapper/107:14:021
200132462,9sleep00-21swapper/005:22:000
1791899467,17cyclictest23120-1kworker/1:0H06:20:271
1791899454,27cyclictest0-21swapper/106:40:591
1791699454,35cyclictest0-21swapper/006:40:400
1791699454,35cyclictest0-21swapper/005:55:420
17916994530,9cyclictest11483-21grep06:11:020
17916994528,12cyclictest0-21swapper/006:00:490
1791699444,14cyclictest0-21swapper/006:05:450
17916994428,11cyclictest0-21swapper/006:55:390
175602443,6sleep00-21swapper/005:16:170
22732432,35sleep00-21swapper/005:55:020
1791699433,33cyclictest0-21swapper/006:50:370
1791899393,8cyclictest17952-21cat05:20:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional