You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 01:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Sep 04, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137721370,13sleep02569999cyclictest09:37:340
25699999624,11cyclictest1124-21snmpd06:42:540
2569999945,81cyclictest0-21swapper/009:22:500
25699999423,12cyclictest0-21swapper/008:12:340
2569999909,73cyclictest18000-21grep07:32:530
2569999907,24cyclictest0-21swapper/009:21:230
2569999907,24cyclictest0-21swapper/009:21:230
2569999905,26cyclictest0-21swapper/008:42:420
2569999903,20cyclictest11630-21ssh10:42:210
2569999894,25cyclictest0-21swapper/007:47:370
2569999884,77cyclictest0-21swapper/009:47:410
2569999883,23cyclictest17703-21ssh09:12:340
2569999877,7cyclictest107550irq/46-eth008:52:360
25699998720,12cyclictest0-21swapper/007:42:370
25699998714,7cyclictest124631ssh09:52:430
2569999864,34cyclictest0-21swapper/010:27:290
2569999854,28cyclictest0-21swapper/009:32:340
2569999853,9cyclictest22390-21gltestperf10:57:290
25699998524,10cyclictest807-21kernelversion07:57:410
25699998524,10cyclictest807-21kernelversion07:57:410
2569999845,72cyclictest0-21swapper/007:41:090
2569999844,73cyclictest0-21swapper/010:52:330
2569999844,32cyclictest19988-21aten_r1power_fr06:32:340
2569999844,32cyclictest0-21swapper/006:12:460
2569999844,14cyclictest0-21swapper/008:50:340
2569999844,12cyclictest0-21swapper/010:51:320
2569999843,34cyclictest0-21swapper/010:04:110
2569999843,28cyclictest31222-21df_abs10:22:300
2569999843,21cyclictest0-21swapper/010:40:450
2569999843,12cyclictest0-21swapper/008:27:330
2569999834,30cyclictest0-21swapper/008:05:260
2569999834,27cyclictest14874-21sed09:57:340
2569999834,27cyclictest14874-21sed09:57:340
2569999834,27cyclictest0-21swapper/010:32:460
2569999834,14cyclictest0-21swapper/008:41:480
2569999834,14cyclictest0-21swapper/008:41:480
2569999834,13cyclictest0-21swapper/005:42:500
2569999834,13cyclictest0-21swapper/005:42:500
2569999834,12cyclictest0-21swapper/010:11:460
2569999833,11cyclictest0-21swapper/008:34:100
2569999833,11cyclictest0-21swapper/008:34:100
25699998323,10cyclictest909-21crond06:32:220
25699998323,10cyclictest909-21crond06:32:220
25699998314,13cyclictest0-21swapper/011:07:110
2569999828,11cyclictest0-21swapper/010:12:390
2569999824,31cyclictest0-21swapper/008:22:420
2569999824,13cyclictest0-21swapper/005:47:560
2569999824,13cyclictest0-21swapper/005:47:560
2569999824,12cyclictest0-21swapper/008:57:300
2569999823,35cyclictest0-21swapper/007:52:430
2569999823,35cyclictest0-21swapper/007:52:430
25699998223,14cyclictest0-21swapper/009:02:430
25699998222,13cyclictest0-21swapper/005:37:370
25699998217,13cyclictest0-21swapper/006:02:530
25699998215,10cyclictest0-21swapper/009:42:530
2569999815,12cyclictest0-21swapper/006:07:490
2569999814,27cyclictest28982-21rm10:17:480
2569999814,27cyclictest0-21swapper/008:17:190
2569999814,15cyclictest0-21swapper/008:12:100
2569999814,12cyclictest0-21swapper/006:17:450
2569999803,29cyclictest0-21swapper/005:53:290
25699998010,9cyclictest107550irq/46-eth009:27:330
25699998010,9cyclictest107550irq/46-eth009:07:310
2569999794,14cyclictest0-21swapper/007:12:340
2569999794,14cyclictest0-21swapper/007:12:340
2569999793,32cyclictest0-21swapper/007:10:160
2569999793,13cyclictest0-21swapper/007:22:310
25699997825,10cyclictest0-21swapper/007:19:520
25699997817,8cyclictest4103-21awk07:07:210
2569999774,11cyclictest0-21swapper/006:48:570
2569999764,13cyclictest0-21swapper/005:57:390
25699997618,7cyclictest23559-21ntpq06:37:480
2569999743,9cyclictest16581-21switchtime06:22:510
2569999733,13cyclictest0-21swapper/006:52:430
14962730,7sleep22570499cyclictest08:47:412
2569999724,14cyclictest0-21swapper/006:57:400
25703997143,12cyclictest0-21swapper/109:32:141
25703996933,11cyclictest0-21swapper/109:02:411
25703996839,11cyclictest0-21swapper/109:57:391
25703996839,11cyclictest0-21swapper/109:57:391
2569999684,12cyclictest0-21swapper/007:27:300
25703996738,9cyclictest12857-21sed10:42:371
25703996733,13cyclictest0-21swapper/107:27:481
2570399664,55cyclictest0-21swapper/107:42:361
2570399664,53cyclictest0-21swapper/110:07:141
2570599654,54cyclictest0-21swapper/310:00:333
2570599654,54cyclictest0-21swapper/310:00:333
2570399654,54cyclictest0-21swapper/108:24:261
25703996538,10cyclictest22391-21python10:07:461
25703996537,9cyclictest1080-21lldpd08:58:341
240972653,9sleep324247-21fschecks_time05:32:423
2570599645,52cyclictest0-21swapper/309:07:423
25705996413,9cyclictest22545-21if_eth010:57:313
25703996440,9cyclictest31070-21munin-node08:42:501
25703996436,12cyclictest0-21swapper/107:47:391
25703996434,13cyclictest0-21swapper/110:37:131
25703996430,11cyclictest0-21swapper/110:52:441
2570399643,45cyclictest0-21swapper/110:48:491
25704996320,10cyclictest0-21swapper/209:46:362
2570399634,52cyclictest0-21swapper/107:57:501
2570399634,52cyclictest0-21swapper/107:57:501
25703996333,14cyclictest0-21swapper/108:12:291
25703996332,14cyclictest0-21swapper/111:02:211
25703996331,10cyclictest0-21swapper/109:19:421
25703996331,10cyclictest0-21swapper/109:19:421
110502633,52sleep20-21swapper/207:19:462
82842623,9sleep38407-21grep07:12:533
82842623,9sleep38407-21grep07:12:533
2570599626,50cyclictest0-21swapper/307:55:593
2570599626,50cyclictest0-21swapper/307:55:593
2570599625,49cyclictest26859-21diskstats08:37:383
2570599625,49cyclictest26859-21diskstats08:37:383
2570599625,14cyclictest0-21swapper/305:46:563
2570599625,14cyclictest0-21swapper/305:46:563
2570599624,51cyclictest0-21swapper/309:47:463
2570599624,50cyclictest0-21swapper/305:57:353
25705996214,42cyclictest23357-21proc_pri07:42:473
2570399624,50cyclictest0-21swapper/107:52:301
2570399624,50cyclictest0-21swapper/107:52:301
25703996235,12cyclictest0-21swapper/109:41:481
25703996235,12cyclictest0-21swapper/108:32:501
25703996235,12cyclictest0-21swapper/108:32:501
25703996234,14cyclictest0-21swapper/110:57:391
25703996234,14cyclictest0-21swapper/110:17:271
25703996234,10cyclictest1729-21ssh10:27:261
25703996233,13cyclictest0-21swapper/110:37:451
25703996233,13cyclictest0-21swapper/106:22:311
25703996219,11cyclictest27192-21latency_hist10:17:141
25703996216,28cyclictest0-21swapper/108:39:231
25703996216,28cyclictest0-21swapper/108:39:231
2570599615,49cyclictest0-21swapper/309:52:353
2570599614,50cyclictest0-21swapper/310:47:083
2570599614,42cyclictest0-21swapper/309:19:483
2570599614,42cyclictest0-21swapper/309:19:483
2570399614,30cyclictest0-21swapper/108:47:361
2570399614,28cyclictest0-21swapper/108:02:371
25703996136,9cyclictest31790-21ssh10:22:361
25703996135,8cyclictest22693-21munin-run08:32:171
25703996134,13cyclictest0-21swapper/106:59:091
25703996133,12cyclictest0-21swapper/107:32:531
25703996133,12cyclictest0-21swapper/106:32:331
219499610,4rtkit-daemon2193-21rtkit-daemon10:35:193
219499610,4rtkit-daemon2193-21rtkit-daemon07:12:123
2570599604,49cyclictest0-21swapper/310:53:093
2570599603,50cyclictest0-21swapper/311:02:263
2570499603,51cyclictest0-21swapper/208:57:422
2570499603,49cyclictest0-21swapper/209:17:412
2570499603,49cyclictest0-21swapper/209:17:412
25704996021,22cyclictest28389-21ls09:27:462
2570399604,50cyclictest0-21swapper/109:16:301
25703996032,13cyclictest0-21swapper/109:42:341
25703996032,13cyclictest0-21swapper/108:52:291
25703996032,12cyclictest0-21swapper/109:52:461
25703996031,14cyclictest0-21swapper/107:02:411
25703996031,14cyclictest0-21swapper/105:37:411
25703996031,13cyclictest0-21swapper/108:17:531
2570399603,50cyclictest12763-21chrt07:22:461
2570599595,48cyclictest0-21swapper/308:55:073
2570599595,12cyclictest0-21swapper/307:37:303
2570599594,14cyclictest0-21swapper/308:19:433
25704995940,12cyclictest0-21swapper/210:42:372
2570499593,50cyclictest0-21swapper/208:37:372
2570499593,50cyclictest0-21swapper/208:37:372
25703995932,13cyclictest0-21swapper/109:22:361
25703995932,12cyclictest0-21swapper/109:33:161
25703995932,12cyclictest0-21swapper/107:38:591
25703995931,13cyclictest0-21swapper/109:47:281
25704995837,7cyclictest25228-21ssh08:34:242
25704995837,7cyclictest25228-21ssh08:34:242
2570399584,29cyclictest0-21swapper/106:37:401
25703995830,12cyclictest0-21swapper/109:08:071
25703995830,12cyclictest0-21swapper/108:07:521
2570599575,13cyclictest0-21swapper/310:07:013
2570599574,48cyclictest0-21swapper/310:27:503
2570599574,15cyclictest0-21swapper/310:18:243
25705995714,30cyclictest0-21swapper/309:15:073
2570499574,46cyclictest0-21swapper/209:32:272
25704995734,8cyclictest15850-21ssh10:47:342
2570499573,49cyclictest0-21swapper/208:57:122
25704995725,17cyclictest8744-21ssh08:09:112
25704995725,15cyclictest0-21swapper/210:02:152
25704995725,15cyclictest0-21swapper/210:02:152
2570499572,49cyclictest0-21swapper/207:50:332
2570399574,47cyclictest31195-21sed06:52:541
2570399574,28cyclictest0-21swapper/106:42:521
112982573,47sleep20-21swapper/209:52:282
2570599564,15cyclictest0-21swapper/308:57:283
2570599564,14cyclictest0-21swapper/309:45:593
2570599564,14cyclictest0-21swapper/309:03:103
2570599564,14cyclictest0-21swapper/308:27:473
2570599564,13cyclictest0-21swapper/305:47:353
2570599564,13cyclictest0-21swapper/305:47:353
25704995639,12cyclictest0-21swapper/207:52:502
25704995639,12cyclictest0-21swapper/207:52:502
25704995638,12cyclictest0-21swapper/210:57:262
25704995631,8cyclictest19406-21ssh10:52:372
2570499563,47cyclictest0-21swapper/210:13:012
219499560,5rtkit-daemon2193-21rtkit-daemon07:22:493
219499560,4rtkit-daemon2193-21rtkit-daemon11:07:102
278512553,10sleep20-21swapper/205:39:372
2570599555,11cyclictest23100-21munin-node08:32:283
2570599555,11cyclictest23100-21munin-node08:32:283
2570599554,13cyclictest0-21swapper/307:22:213
2570599554,12cyclictest32765-21latency_hist08:47:183
2570599553,37cyclictest25458-21runrttasks09:22:583
2570599553,35cyclictest0-21swapper/307:51:063
2570599553,10cyclictest0-21swapper/310:47:253
2570499554,46cyclictest0-21swapper/209:06:322
25704995530,9cyclictest2480-21ssh10:27:322
2570499553,47cyclictest0-21swapper/210:17:282
2570499553,47cyclictest0-21swapper/208:42:352
25703995535,11cyclictest9105-21munin-node07:17:541
219499550,5rtkit-daemon2193-21rtkit-daemon08:19:472
2570599545,9cyclictest1127-21tail09:37:313
2570599544,15cyclictest0-21swapper/310:08:343
2570599544,14cyclictest0-21swapper/310:38:373
2570599544,12cyclictest0-21swapper/308:26:273
2570599544,10cyclictest850-21latency07:57:413
2570599544,10cyclictest850-21latency07:57:413
2570599543,10cyclictest16619-21cpuspeed_turbos07:32:343
25705995413,25cyclictest0-21swapper/309:33:053
2570499544,42cyclictest0-21swapper/209:47:392
25704995437,11cyclictest0-21swapper/206:17:452
2570499543,46cyclictest0-21swapper/210:26:072
25704995424,14cyclictest0-21swapper/206:07:232
25704995411,37cyclictest17870-21cpuspeed_turbos10:02:302
2570399544,27cyclictest0-21swapper/106:16:051
25703995439,10cyclictest0-21swapper/106:02:451
219499540,5rtkit-daemon2193-21rtkit-daemon10:07:422
219499540,5rtkit-daemon2193-21rtkit-daemon08:12:322
170672540,6sleep2281ktimersoftd/207:32:382
89742533,43sleep20-21swapper/206:07:462
45982532,10sleep20-21swapper/208:02:472
2570599535,29cyclictest0-21swapper/309:27:353
2570599535,29cyclictest0-21swapper/305:52:353
2570599534,12cyclictest0-21swapper/308:11:303
2570599533,10cyclictest0-21swapper/308:12:363
25705995323,11cyclictest976-21diskstats08:47:333
25704995338,8cyclictest19065-21ssh07:37:332
25704995333,13cyclictest0-21swapper/210:40:482
2570499533,46cyclictest0-21swapper/207:42:462
2570499533,45cyclictest0-21swapper/210:32:442
2570499533,44cyclictest0-21swapper/208:27:422
219499530,5rtkit-daemon2193-21rtkit-daemon08:22:472
2570599525,28cyclictest0-21swapper/306:52:483
2570599525,27cyclictest0-21swapper/307:02:433
2570599524,29cyclictest0-21swapper/310:15:393
2570599524,29cyclictest0-21swapper/307:27:423
2570599524,28cyclictest0-21swapper/310:22:303
2570599524,27cyclictest0-21swapper/306:46:303
25705995236,9cyclictest27920-21cut06:47:403
2570599523,8cyclictest32483-21fschecks_count06:57:393
25705995211,23cyclictest0-21swapper/308:07:073
2570499523,44cyclictest0-21swapper/209:07:252
2570499523,28cyclictest0-21swapper/209:37:532
2570499523,28cyclictest0-21swapper/207:57:352
2570499523,28cyclictest0-21swapper/207:57:352
25704995222,14cyclictest0-21swapper/207:27:312
2570399525,30cyclictest0-21swapper/106:07:401
2570399524,26cyclictest0-21swapper/107:07:561
25703995223,15cyclictest0-21swapper/106:17:491
25703995219,12cyclictest681-21telnet05:52:351
203592523,7sleep320477-21diskstats06:32:383
2570599514,27cyclictest0-21swapper/306:11:253
25705995119,15cyclictest0-21swapper/306:17:403
25705995119,14cyclictest0-21swapper/306:37:343
25705995119,14cyclictest0-21swapper/306:03:533
2570499514,39cyclictest0-21swapper/207:12:432
2570499514,39cyclictest0-21swapper/207:12:432
25704995133,11cyclictest0-21swapper/205:52:362
25704995130,13cyclictest0-21swapper/209:12:422
2570499513,43cyclictest0-21swapper/206:34:542
2570499513,43cyclictest0-21swapper/206:16:252
25704995123,13cyclictest0-21swapper/209:22:312
2570399514,27cyclictest0-21swapper/105:47:591
2570399514,27cyclictest0-21swapper/105:47:591
2570399513,23cyclictest0-21swapper/107:15:581
2570399513,23cyclictest0-21swapper/107:15:581
2570599505,28cyclictest0-21swapper/306:12:513
2570599504,27cyclictest0-21swapper/306:27:453
2570599504,27cyclictest0-21swapper/306:27:453
2570599504,26cyclictest0-21swapper/306:26:273
2570599503,8cyclictest27369-21python05:37:553
2570499503,39cyclictest0-21swapper/206:57:432
25704995028,9cyclictest1124-21snmpd05:57:562
25704995028,8cyclictest22289-21munin-node06:37:362
25704995019,12cyclictest0-21swapper/207:23:572
2570399504,23cyclictest17563-21telnet06:27:341
2570399504,23cyclictest17563-21telnet06:27:341
2570399504,23cyclictest0-21swapper/106:47:331
2570399504,22cyclictest0-21swapper/105:42:371
2570399504,22cyclictest0-21swapper/105:42:371
2570399503,25cyclictest0-21swapper/106:01:231
266902492,9sleep20-21swapper/206:45:392
2570499495,37cyclictest0-21swapper/205:47:472
2570499495,37cyclictest0-21swapper/205:47:472
2570499494,39cyclictest0-21swapper/206:22:422
2570499483,38cyclictest0-21swapper/205:42:502
2570499483,38cyclictest0-21swapper/205:42:502
25704994827,8cyclictest4385-21aten2.4-expect07:07:322
25704994820,12cyclictest0-21swapper/206:47:412
25704994718,13cyclictest0-21swapper/206:52:362
2570499463,37cyclictest0-21swapper/206:27:392
2570499463,37cyclictest0-21swapper/206:27:392
2570399453,20cyclictest25729-21cat05:37:251
25704994420,11cyclictest0-21swapper/207:02:402
25704994211,25cyclictest25677-21latency_hist05:37:252
25699993715,8cyclictest25677-21latency_hist05:37:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional