You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 03:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Jan 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23960991057,51cyclictest890-21awk23:38:220
239659910440,13cyclictest0-21swapper/223:13:232
23966991005,87cyclictest0-21swapper/323:43:333
2396099994,52cyclictest0-21swapper/023:03:230
2396099994,52cyclictest0-21swapper/023:03:230
2396599984,48cyclictest5439-21grep21:29:022
2396599984,48cyclictest5439-21grep21:29:022
2396599973,47cyclictest7065-21latency_hist22:43:252
2396599963,44cyclictest0-21swapper/223:38:362
23966999535,12cyclictest0-21swapper/300:03:543
23966999533,12cyclictest0-21swapper/323:18:233
2396699953,52cyclictest1287-21snmpd19:04:543
23960999430,13cyclictest0-21swapper/000:03:400
2396099943,7cyclictest9510-21latency_hist20:33:300
23965999036,12cyclictest0-21swapper/222:28:582
23966998936,11cyclictest0-21swapper/320:29:073
23965998931,12cyclictest0-21swapper/200:13:362
23965998928,12cyclictest0-21swapper/220:48:302
23965998928,12cyclictest0-21swapper/220:48:302
2396599884,52cyclictest6210-21munin-node19:18:562
23965998829,12cyclictest0-21swapper/200:03:512
2396699874,48cyclictest6089-21cut22:38:503
2396599813,49cyclictest0-21swapper/223:23:232
248599660,5rtkit-daemon2484-21rtkit-daemon23:27:260
2396699665,53cyclictest1419-21runrttasks22:28:433
23966996638,12cyclictest0-21swapper/321:53:553
23965996538,12cyclictest0-21swapper/219:28:572
23966996441,8cyclictest29136-21sendmail_mailqu20:04:013
23966996441,8cyclictest29136-21sendmail_mailqu20:04:013
23966996436,12cyclictest0-21swapper/323:03:553
2396699633,53cyclictest0-21swapper/322:23:373
23965996340,9cyclictest20887-21cpuspeed_turbos19:48:472
2396599634,52cyclictest0-21swapper/222:23:512
23965996336,12cyclictest0-21swapper/221:53:432
23965996336,10cyclictest11096-21rt-features22:48:582
2396599633,53cyclictest10916-21munin-node21:43:452
2396699624,51cyclictest22424-21fschecks_time20:58:473
23966996236,12cyclictest0-21swapper/320:38:293
23966996235,12cyclictest0-21swapper/322:33:523
23966996234,13cyclictest0-21swapper/319:53:463
23965996239,8cyclictest447-21grep21:19:012
23965996233,12cyclictest0-21swapper/222:33:522
2396599623,52cyclictest0-21swapper/219:23:432
2396599623,52cyclictest0-21swapper/219:23:432
2396599622,46cyclictest0-21swapper/222:55:392
23960996233,13cyclictest0-21swapper/023:43:380
23966996139,7cyclictest30955-21munin-run23:33:223
23966996136,11cyclictest0-21swapper/322:08:263
23965996139,10cyclictest0-21swapper/219:04:052
23965996134,12cyclictest0-21swapper/219:34:022
128042613,49sleep10-21swapper/119:29:171
248599600,4rtkit-daemon2484-21rtkit-daemon19:33:500
2396699603,51cyclictest0-21swapper/318:53:343
2396499606,33cyclictest0-21swapper/121:10:121
2396499605,33cyclictest0-21swapper/121:58:591
2396099603,51cyclictest0-21swapper/020:08:530
2396099603,51cyclictest0-21swapper/020:08:530
23965995934,9cyclictest30223-21yum-updatesd-he23:28:552
2396499597,45cyclictest0-21swapper/121:33:471
2396499596,13cyclictest0-21swapper/123:58:501
2396499595,29cyclictest0-21swapper/100:03:521
2396499594,32cyclictest0-21swapper/121:43:391
23960995932,12cyclictest0-21swapper/018:48:480
23960995930,13cyclictest0-21swapper/019:08:320
23966995835,11cyclictest0-21swapper/321:03:433
23966995834,9cyclictest14630-21proc_pri21:48:563
23966995834,11cyclictest0-21swapper/321:13:503
23966995834,11cyclictest0-21swapper/320:25:063
23966995833,11cyclictest0-21swapper/322:58:533
23966995833,11cyclictest0-21swapper/322:58:533
23966995832,11cyclictest0-21swapper/319:29:063
2396699583,49cyclictest0-21swapper/319:58:513
23966995823,28cyclictest27006-21df_abs21:08:443
2396699582,51cyclictest0-21swapper/318:59:083
23965995837,8cyclictest9924-21rt-features21:38:572
2396599582,51cyclictest0-21swapper/221:13:482
2396499586,31cyclictest0-21swapper/123:44:431
2396499586,31cyclictest0-21swapper/119:52:181
2396499585,32cyclictest0-21swapper/123:08:471
2396499585,31cyclictest0-21swapper/122:38:451
2396499585,29cyclictest0-21swapper/122:08:491
2396499584,32cyclictest0-21swapper/121:40:171
2396499583,49cyclictest0-21swapper/119:00:421
23960995834,9cyclictest41ktimersoftd/019:19:030
157562586,44sleep30-21swapper/320:44:003
157562586,44sleep30-21swapper/320:44:003
23966995735,8cyclictest18357-21sendmail_mailqu20:48:583
23966995735,8cyclictest18357-21sendmail_mailqu20:48:583
2396699572,50cyclictest0-21swapper/322:53:373
2396699572,50cyclictest0-21swapper/318:58:343
2396599574,47cyclictest13311-21basename21:48:392
23965995732,11cyclictest0-21swapper/220:03:512
23965995732,11cyclictest0-21swapper/220:03:512
2396599573,48cyclictest5028-21telnet20:23:392
2396599572,50cyclictest0-21swapper/223:43:352
2396499575,31cyclictest0-21swapper/122:20:081
2396499575,28cyclictest0-21swapper/122:49:021
2396499574,31cyclictest0-21swapper/122:23:391
2396499574,13cyclictest0-21swapper/122:08:261
2396099574,47cyclictest0-21swapper/022:29:020
23960995730,13cyclictest0-21swapper/021:28:510
23960995730,13cyclictest0-21swapper/021:28:510
23960995730,12cyclictest0-21swapper/021:48:420
2396099573,48cyclictest0-21swapper/021:33:390
23960995729,13cyclictest0-21swapper/020:48:460
23960995729,13cyclictest0-21swapper/020:48:460
23960995729,12cyclictest0-21swapper/020:04:070
23960995729,12cyclictest0-21swapper/020:04:070
205882573,47sleep20-21swapper/222:03:402
80722563,47sleep18183-21hddtemp_smartct22:43:451
23966995634,10cyclictest0-21swapper/321:23:453
23966995630,11cyclictest0-21swapper/321:38:523
2396699563,48cyclictest0-21swapper/323:22:223
23965995636,9cyclictest0-21swapper/219:10:512
23965995631,11cyclictest0-21swapper/218:48:352
2396599562,49cyclictest0-21swapper/221:38:282
2396599562,48cyclictest0-21swapper/218:54:202
2396599562,48cyclictest0-21swapper/200:10:082
2396499566,30cyclictest0-21swapper/119:04:541
2396499566,26cyclictest0-21swapper/120:33:551
2396499565,31cyclictest0-21swapper/118:49:521
2396499565,28cyclictest0-21swapper/123:34:411
2396499564,29cyclictest0-21swapper/100:09:471
23964995620,21cyclictest17849-21crond21:58:251
2396099564,46cyclictest0-21swapper/023:42:140
2396099563,48cyclictest0-21swapper/019:47:250
2396099563,46cyclictest1345-21tail21:23:390
23960995629,12cyclictest0-21swapper/022:49:010
23960995628,13cyclictest0-21swapper/019:32:380
23960995622,22cyclictest0-21swapper/018:59:030
203412565,44sleep30-21swapper/320:53:523
248599550,5rtkit-daemon2484-21rtkit-daemon23:28:480
248599550,5rtkit-daemon2484-21rtkit-daemon20:13:480
2396699553,47cyclictest0-21swapper/319:19:133
23966995529,13cyclictest0-21swapper/323:08:343
2396699552,48cyclictest0-21swapper/323:53:373
2396699552,48cyclictest0-21swapper/320:08:323
2396699552,48cyclictest0-21swapper/320:08:323
2396699552,48cyclictest0-21swapper/319:17:113
2396699552,48cyclictest0-21swapper/300:12:263
23965995533,11cyclictest0-21swapper/220:15:252
23965995532,12cyclictest0-21swapper/223:50:042
2396599552,48cyclictest0-21swapper/220:59:222
2396599552,48cyclictest0-21swapper/219:02:442
2396599552,48cyclictest0-21swapper/200:01:372
2396599552,47cyclictest0-21swapper/222:08:382
2396599552,47cyclictest0-21swapper/221:10:012
2396099554,45cyclictest22294-21grep23:13:410
23960995533,8cyclictest41ktimersoftd/020:39:020
23960995532,9cyclictest19256-21telnet23:08:330
23960995530,9cyclictest41ktimersoftd/020:34:000
23960995528,13cyclictest0-21swapper/022:23:360
23960995528,12cyclictest0-21swapper/022:33:420
2396099552,47cyclictest0-21swapper/018:53:510
286052543,44sleep00-21swapper/022:18:490
248599540,5rtkit-daemon2484-21rtkit-daemon22:53:490
248599540,5rtkit-daemon2484-21rtkit-daemon21:44:000
23966995436,9cyclictest18191-21telnet19:43:423
23966995435,8cyclictest13543-21rt-features20:39:023
23966995432,11cyclictest0-21swapper/321:29:053
23966995432,11cyclictest0-21swapper/321:29:053
2396699543,42cyclictest3203-21fschecks_count20:18:483
2396699542,47cyclictest0-21swapper/323:38:583
2396699542,47cyclictest0-21swapper/323:26:353
23965995433,8cyclictest30171-21aten_r1power_fr20:08:432
23965995433,8cyclictest30171-21aten_r1power_fr20:08:432
23965995433,7cyclictest8798-21mailstats20:29:002
23965995433,10cyclictest0-21swapper/220:53:412
23965995432,10cyclictest0-21swapper/218:48:462
2396599542,47cyclictest0-21swapper/223:23:532
2396599542,47cyclictest0-21swapper/222:58:372
2396599542,47cyclictest0-21swapper/222:58:372
2396599542,47cyclictest0-21swapper/221:26:322
2396599542,46cyclictest0-21swapper/219:58:532
2396599542,46cyclictest0-21swapper/219:54:082
2396599542,46cyclictest0-21swapper/219:14:392
2396599541,48cyclictest0-21swapper/220:42:272
2396599541,47cyclictest0-21swapper/219:42:412
2396499546,27cyclictest0-21swapper/122:55:291
2396499544,28cyclictest0-21swapper/122:38:241
23964995438,10cyclictest13728-21cut19:33:471
2396099544,44cyclictest0-21swapper/022:03:440
2396099544,42cyclictest0-21swapper/021:53:500
23960995431,9cyclictest41ktimersoftd/020:19:000
2396099543,45cyclictest0-21swapper/021:58:450
2396099543,44cyclictest0-21swapper/021:07:410
23960995429,11cyclictest0-21swapper/021:13:500
23960995428,12cyclictest0-21swapper/020:43:570
23960995428,12cyclictest0-21swapper/020:43:570
23960995428,12cyclictest0-21swapper/019:48:440
23960995428,12cyclictest0-21swapper/000:01:190
23960995427,12cyclictest0-21swapper/022:08:440
2396099542,44cyclictest0-21swapper/021:43:280
248599530,5rtkit-daemon2484-21rtkit-daemon22:43:420
248599530,5rtkit-daemon2484-21rtkit-daemon22:38:430
248599530,5rtkit-daemon2484-21rtkit-daemon20:58:540
248599530,5rtkit-daemon2484-21rtkit-daemon00:13:390
23966995339,8cyclictest20889-21cpuspeed_turbos19:48:473
23966995335,8cyclictest10844-21munin-node23:58:463
23966995330,11cyclictest0-21swapper/323:48:343
2396599533,42cyclictest0-21swapper/221:58:382
2396599532,46cyclictest0-21swapper/223:56:382
2396599532,46cyclictest0-21swapper/222:16:442
2396599532,46cyclictest0-21swapper/222:16:442
2396599532,46cyclictest0-21swapper/220:46:572
2396599532,46cyclictest0-21swapper/220:46:572
2396599532,46cyclictest0-21swapper/220:33:312
2396599532,46cyclictest0-21swapper/219:43:582
2396599532,45cyclictest0-21swapper/223:05:052
2396599532,45cyclictest0-21swapper/221:03:582
23965995316,31cyclictest868-21crond23:38:222
2396499535,33cyclictest0-21swapper/119:43:511
23964995316,23cyclictest12194-21telnet20:38:421
23960995332,9cyclictest19444-21telnet20:53:410
2396099533,44cyclictest8751-21chrt19:23:430
2396099533,44cyclictest8751-21chrt19:23:430
2396099533,44cyclictest17743-21http_loadtime23:03:460
2396099533,44cyclictest0-21swapper/019:43:310
23960995326,12cyclictest0-21swapper/023:58:220
23960995324,13cyclictest0-21swapper/023:48:370
23960995324,13cyclictest0-21swapper/019:14:030
237222534,41sleep00-21swapper/018:45:510
82202524,10sleep10-21swapper/123:53:221
259972522,43sleep00-21swapper/023:21:210
2396699525,41cyclictest0-21swapper/322:13:253
23966995230,10cyclictest0-21swapper/319:39:133
23966995228,12cyclictest0-21swapper/321:18:393
23966995228,11cyclictest0-21swapper/322:43:383
23966995226,14cyclictest0-21swapper/319:09:053
23966995225,13cyclictest0-21swapper/321:33:403
2396699522,46cyclictest0-21swapper/319:25:043
2396699522,46cyclictest0-21swapper/319:25:043
2396599523,43cyclictest0-21swapper/223:13:352
23965995226,11cyclictest0-21swapper/220:23:302
2396599521,47cyclictest0-21swapper/222:45:472
2396499526,41cyclictest0-21swapper/120:03:311
2396499525,31cyclictest0-21swapper/120:23:561
2396499524,27cyclictest0-21swapper/123:24:391
2396099523,44cyclictest0-21swapper/019:58:550
248599510,5rtkit-daemon2484-21rtkit-daemon20:23:400
2396699514,40cyclictest0-21swapper/321:58:383
23966995129,11cyclictest0-21swapper/322:14:183
23966995129,11cyclictest0-21swapper/322:14:183
23966995129,11cyclictest0-21swapper/319:33:453
23966995127,12cyclictest0-21swapper/322:48:413
23966995127,12cyclictest0-21swapper/321:46:513
2396599512,44cyclictest0-21swapper/222:19:012
2396499517,30cyclictest0-21swapper/119:08:561
2396499515,40cyclictest0-21swapper/120:08:541
2396499515,40cyclictest0-21swapper/120:08:541
23964995134,10cyclictest862-21hwlatdetect22:28:441
2396099513,42cyclictest0-21swapper/021:08:510
23960995123,12cyclictest0-21swapper/019:08:520
22532513,42sleep11243-21lldpd20:17:541
248599500,5rtkit-daemon2484-21rtkit-daemon21:19:010
23966995035,9cyclictest27984-21cut22:18:413
2396499505,31cyclictest0-21swapper/120:53:501
2396499505,29cyclictest0-21swapper/120:29:021
2396499504,31cyclictest0-21swapper/119:54:001
163682503,10sleep10-21swapper/123:00:181
163682503,10sleep10-21swapper/123:00:181
94862493,40sleep19582-21memory23:53:471
82862493,40sleep10-21swapper/119:22:401
252782493,40sleep10-21swapper/123:18:521
2396699493,39cyclictest0-21swapper/320:13:413
2396099493,41cyclictest0-21swapper/000:09:040
23960994926,12cyclictest0-21swapper/019:55:020
2396099492,40cyclictest0-21swapper/022:13:380
2396099492,40cyclictest0-21swapper/022:13:380
235442493,40sleep10-21swapper/120:59:261
57502483,39sleep10-21swapper/119:15:431
270982483,10sleep10-21swapper/122:14:391
270982483,10sleep10-21swapper/122:14:391
2396699485,23cyclictest0-21swapper/300:13:353
2396699483,38cyclictest0-21swapper/318:48:343
23966994826,11cyclictest0-21swapper/323:34:403
237312483,39sleep10-21swapper/123:18:031
56372474,9sleep10-21swapper/121:30:101
56372474,9sleep10-21swapper/121:30:101
2396499467,28cyclictest0-21swapper/121:13:401
2396499465,12cyclictest18804-21gltestperf00:13:421
23964994632,10cyclictest8932-21cpuspeed_turbos19:23:441
23964994632,10cyclictest8932-21cpuspeed_turbos19:23:441
31432453,36sleep10-21swapper/123:39:241
2396499453,35cyclictest0-21swapper/121:49:001
23964994527,12cyclictest0-21swapper/119:38:471
284392443,10sleep10-21swapper/118:55:031
2396499445,30cyclictest0-21swapper/120:18:521
2396499443,36cyclictest0-21swapper/121:05:151
23964994429,9cyclictest28908-21tail23:28:351
295742433,34sleep10-21swapper/120:04:481
295742433,34sleep10-21swapper/120:04:481
2396499434,34cyclictest0-21swapper/120:48:481
2396499434,34cyclictest0-21swapper/120:48:481
2396499433,12cyclictest0-21swapper/121:23:531
23964994327,11cyclictest0-21swapper/121:19:201
188192433,10sleep10-21swapper/123:06:101
166322433,34sleep10-21swapper/120:47:491
166322433,34sleep10-21swapper/120:47:491
2396499395,25cyclictest0-21swapper/118:48:331
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional