You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-31 - 03:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Aug 31, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
219499980,5rtkit-daemon21697-21diskstats20:51:491
1413499984,24cyclictest0-21swapper/019:46:250
1413499984,24cyclictest0-21swapper/019:46:250
219499970,6rtkit-daemon21-21ksoftirqd/120:39:051
219499960,6rtkit-daemon0-21swapper/119:04:091
219499960,6rtkit-daemon0-21swapper/119:04:091
219499940,6rtkit-daemon0-21swapper/119:57:141
219499940,6rtkit-daemon0-21swapper/119:32:371
219499940,6rtkit-daemon0-21swapper/118:52:461
1413499943,43cyclictest0-21swapper/022:25:180
219499930,6rtkit-daemon0-21swapper/119:09:161
219499930,6rtkit-daemon0-21swapper/118:48:391
219499930,5rtkit-daemon6088-21ssh22:55:591
1413499934,26cyclictest0-21swapper/017:51:550
1413499933,26cyclictest0-21swapper/022:51:540
219499920,6rtkit-daemon0-21swapper/122:58:221
219499920,6rtkit-daemon0-21swapper/121:31:251
219499920,6rtkit-daemon0-21swapper/121:05:341
219499920,6rtkit-daemon0-21swapper/120:59:271
219499920,6rtkit-daemon0-21swapper/119:50:291
219499920,6rtkit-daemon0-21swapper/119:41:451
219499920,6rtkit-daemon0-21swapper/119:41:451
219499920,6rtkit-daemon0-21swapper/119:37:151
219499920,6rtkit-daemon0-21swapper/119:30:001
219499920,6rtkit-daemon0-21swapper/119:23:381
219499920,6rtkit-daemon0-21swapper/118:22:101
219499920,5rtkit-daemon17352-21ssh20:45:501
1413499929,25cyclictest0-21swapper/021:46:460
1413499924,31cyclictest0-21swapper/022:42:430
219499910,6rtkit-daemon0-21swapper/122:42:221
219499910,6rtkit-daemon0-21swapper/121:59:241
219499910,6rtkit-daemon0-21swapper/121:15:481
219499910,6rtkit-daemon0-21swapper/121:10:261
219499910,6rtkit-daemon0-21swapper/121:10:261
219499910,6rtkit-daemon0-21swapper/120:18:061
219499910,6rtkit-daemon0-21swapper/119:19:381
219499910,6rtkit-daemon0-21swapper/118:45:321
219499910,6rtkit-daemon0-21swapper/118:18:401
219499910,4rtkit-daemon18-21rcuc/120:01:512
1413499914,28cyclictest0-21swapper/020:02:080
1413499914,26cyclictest0-21swapper/022:11:420
14134999136,10cyclictest31931-21grep18:16:560
14134999129,8cyclictest31801-21ssh21:06:510
14134999129,8cyclictest31801-21ssh21:06:510
14134999121,12cyclictest0-21swapper/018:02:060
14134999116,12cyclictest0-21swapper/020:36:480
14134999114,14cyclictest0-21swapper/019:56:490
219499900,6rtkit-daemon0-21swapper/123:02:071
1413499904,27cyclictest0-21swapper/020:54:420
1413499904,25cyclictest0-21swapper/021:25:360
14134999034,9cyclictest25376-21tr19:11:480
219499890,6rtkit-daemon0-21swapper/119:54:591
1413499897,23cyclictest0-21swapper/023:09:330
1413499894,27cyclictest0-21swapper/020:18:550
1413499894,26cyclictest0-21swapper/020:22:040
1413499894,25cyclictest0-21swapper/022:20:460
14134998936,10cyclictest29350-21grep21:02:070
1413499893,26cyclictest0-21swapper/022:41:280
1413499893,26cyclictest0-21swapper/021:53:390
1413499893,26cyclictest0-21swapper/020:06:560
1413499893,26cyclictest0-21swapper/019:47:080
14134998918,12cyclictest0-21swapper/018:52:030
219499880,4rtkit-daemon6886-21diskmemload21:55:171
219499880,4rtkit-daemon1165-21ssh20:21:361
1413499884,24cyclictest0-21swapper/021:40:480
1413499883,39cyclictest1227-21runrttasks18:15:530
1413499883,39cyclictest1227-21runrttasks18:15:530
1413499883,26cyclictest0-21swapper/022:34:410
1413499883,26cyclictest0-21swapper/021:12:000
219499870,4rtkit-daemon10823-21ssh20:36:051
219499870,19rtkit-daemon0-21swapper/020:30:201
219499870,19rtkit-daemon0-21swapper/020:30:201
1413499874,25cyclictest0-21swapper/020:16:290
1413499864,27cyclictest0-21swapper/022:07:050
1413499864,26cyclictest0-21swapper/020:49:390
1413499864,26cyclictest0-21swapper/019:51:580
1413499864,25cyclictest0-21swapper/021:31:560
1413499863,25cyclictest0-21swapper/018:41:510
14141998538,39cyclictest31938-21cpuspeed_turbos21:56:423
1413499854,27cyclictest0-21swapper/022:27:020
1413499854,27cyclictest0-21swapper/018:36:560
1413499854,27cyclictest0-21swapper/018:22:090
1413499854,25cyclictest0-21swapper/020:31:430
1413499853,38cyclictest0-21swapper/019:06:140
1413499853,38cyclictest0-21swapper/019:06:140
14141998438,39cyclictest19087-21aten_r1power_en22:26:393
1413499845,25cyclictest0-21swapper/020:44:270
1413499844,30cyclictest0-21swapper/022:04:450
1413499844,12cyclictest0-21swapper/021:29:300
14134998419,13cyclictest0-21swapper/020:31:190
14134998419,13cyclictest0-21swapper/020:31:190
14141998335,42cyclictest17842-21cut19:56:543
14141998329,48cyclictest0-21swapper/322:47:013
1413499834,12cyclictest0-21swapper/022:47:430
14141998226,47cyclictest0-21swapper/320:48:073
14141998217,58cyclictest13195-21ssh19:50:403
1413499825,25cyclictest0-21swapper/022:59:010
1413499825,25cyclictest0-21swapper/017:43:170
1413499824,30cyclictest0-21swapper/017:56:490
1413499824,27cyclictest0-21swapper/019:27:080
1413499823,25cyclictest21955-21ssh21:41:420
219499810,27rtkit-daemon0-21swapper/022:04:311
14141998136,39cyclictest15127-21runrttasks22:20:113
14141998136,38cyclictest22785-21aten_r1power_po19:06:463
1413499814,27cyclictest0-21swapper/020:57:000
1413499814,27cyclictest0-21swapper/019:16:500
219499800,27rtkit-daemon0-21swapper/021:32:331
14141998040,34cyclictest1227-21runrttasks21:31:423
14141998029,44cyclictest276811munin-node21:02:013
1413499804,26cyclictest0-21swapper/023:01:270
14141997937,35cyclictest1227-21runrttasks22:37:123
14141997933,40cyclictest31814-21gltestperf21:06:513
14141997933,40cyclictest31814-21gltestperf21:06:513
14141997926,47cyclictest0-21swapper/322:44:033
14141997922,51cyclictest0-21swapper/321:18:003
1413499793,27cyclictest0-21swapper/021:21:120
1413499793,26cyclictest0-21swapper/019:23:410
14134997918,12cyclictest0-21swapper/021:58:490
219499780,26rtkit-daemon0-21swapper/018:31:551
219499780,25rtkit-daemon20206-21chrt21:37:031
14141997833,39cyclictest19871-21processes21:36:583
14141997830,42cyclictest0-21swapper/319:51:553
14141997830,40cyclictest0-21swapper/322:33:273
14141997828,44cyclictest0-21swapper/322:08:253
14141997825,45cyclictest235231sshd17:59:513
14141997822,49cyclictest0-21swapper/320:08:173
219499770,26rtkit-daemon0-21swapper/022:41:151
14141997738,32cyclictest11985-21fschecks_time20:36:513
14141997735,35cyclictest1227-21runrttasks23:06:383
14141997731,40cyclictest26102-21cat21:46:533
14141997731,40cyclictest2057-21awk19:31:343
14141997731,40cyclictest0-21swapper/320:56:453
14141997731,39cyclictest0-21swapper/319:43:183
14141997731,39cyclictest0-21swapper/319:43:183
14141997730,41cyclictest3998-21perl22:51:453
14141997730,41cyclictest10650-21python22:11:583
14141997730,40cyclictest27666-21cpuspeed19:16:483
14141997730,40cyclictest0-21swapper/321:11:403
14141997729,41cyclictest0-21swapper/320:17:053
14141997726,43cyclictest0-21swapper/323:00:543
14141997725,46cyclictest0-21swapper/321:43:193
14134997732,9cyclictest17488-21tune2fs17:46:570
219499760,24rtkit-daemon0-21swapper/021:24:481
219499760,23rtkit-daemon0-21swapper/022:47:001
14141997632,39cyclictest9444-21ssh21:21:503
14141997625,43cyclictest0-21swapper/321:27:343
14140997624,44cyclictest31855-21ssh20:17:052
219499750,25rtkit-daemon0-21swapper/021:47:101
14141997531,38cyclictest0-21swapper/320:16:283
14141997530,39cyclictest3325-21basename18:26:373
14141997530,39cyclictest0-21swapper/320:29:353
14141997530,39cyclictest0-21swapper/320:29:353
14141997524,44cyclictest0-21swapper/320:55:073
14140997527,41cyclictest25889-21head21:46:492
14141997431,36cyclictest18385-21taskset22:25:023
14141997429,39cyclictest225991ssh20:03:063
14141997429,38cyclictest14976-21grep17:41:553
14141997426,15cyclictest0-21swapper/318:11:553
14141997426,15cyclictest0-21swapper/318:11:553
14141997425,12cyclictest9298-21grep20:32:003
14141997423,44cyclictest0-21swapper/320:23:353
14141997422,46cyclictest0-21swapper/323:03:253
14140997414,53cyclictest19181-21aten_r1power_en17:51:522
219499730,23rtkit-daemon0-21swapper/018:57:091
219499730,23rtkit-daemon0-21swapper/018:57:091
14141997332,35cyclictest31057-21munin-node18:17:113
14141997330,38cyclictest0-21swapper/322:01:383
14141997330,37cyclictest30296-21ssh21:52:373
14140997321,46cyclictest0-21swapper/220:47:002
14141997226,21cyclictest0-21swapper/320:42:133
14141997225,39cyclictest31237-21munin-node19:22:033
14141997223,42cyclictest0-21swapper/318:36:363
14140997219,46cyclictest0-21swapper/221:23:422
14140997219,45cyclictest0-21swapper/221:42:012
14140997217,49cyclictest0-21swapper/222:06:272
219499710,23rtkit-daemon0-21swapper/020:47:341
14141997128,37cyclictest0-21swapper/319:11:553
14141997128,37cyclictest0-21swapper/318:37:063
14141997125,40cyclictest0-21swapper/319:31:513
14140997119,45cyclictest0-21swapper/222:34:462
14141997044,21cyclictest0-21swapper/318:06:383
14141997029,34cyclictest4728-21munin-node19:36:543
14141997025,40cyclictest0-21swapper/319:05:243
14141997025,40cyclictest0-21swapper/319:05:243
14141997025,40cyclictest0-21swapper/318:56:473
14141997025,40cyclictest0-21swapper/318:56:473
14140997030,35cyclictest5975-21aten_r1power_po22:06:422
14140997028,36cyclictest1227-21runrttasks23:03:082
14140997026,13cyclictest1227-21runrttasks20:31:132
14140997026,13cyclictest1227-21runrttasks20:31:132
14140997025,38cyclictest25512-21unixbench_multi20:07:072
14140997014,22cyclictest0-21swapper/221:40:052
14141996945,13cyclictest15235-21runrttasks18:51:093
14141996925,38cyclictest15632-21aten2.4-expect18:51:493
14140996921,43cyclictest0-21swapper/221:11:202
14140996921,43cyclictest0-21swapper/221:11:202
14140996921,42cyclictest0-21swapper/222:36:452
14140996917,46cyclictest0-21swapper/221:11:522
14140996829,33cyclictest17930-21gltestperf19:56:552
14140996824,38cyclictest889-21rs:main2
14140996821,41cyclictest0-21swapper/222:51:552
14140996816,47cyclictest0-21swapper/219:50:532
14140996816,44cyclictest0-21swapper/219:51:522
14141996743,14cyclictest28307-21runrttasks18:09:593
14140996721,39cyclictest0-21swapper/221:27:012
14140996720,41cyclictest0-21swapper/218:57:082
14140996720,41cyclictest0-21swapper/218:57:082
14140996717,44cyclictest0-21swapper/222:17:312
14140996717,42cyclictest0-21swapper/222:46:372
14140996716,45cyclictest25611-21missed_timers20:56:562
14140996715,46cyclictest0-21swapper/221:51:502
14141996643,16cyclictest20947-21runrttasks17:52:223
14141996643,16cyclictest10718-21runrttasks18:41:383
14141996641,14cyclictest4269-21perl18:26:563
14140996620,39cyclictest14010-21munin-node23:06:452
14140996619,41cyclictest0-21swapper/219:12:052
14140996619,29cyclictest28551-21python20:12:032
14140996618,42cyclictest0-21swapper/217:51:382
14140996616,43cyclictest0-21swapper/221:36:142
14140996613,45cyclictest0-21swapper/219:44:322
14140996613,45cyclictest0-21swapper/219:44:322
219499650,7rtkit-daemon30445-21grep18:12:111
219499650,7rtkit-daemon30445-21grep18:12:111
1414099657,51cyclictest0-21swapper/223:01:182
14140996523,36cyclictest13857-21tune2fs18:46:532
14140996522,37cyclictest22150-21runrttasks20:51:542
14140996520,39cyclictest1227-21runrttasks20:32:042
14140996518,41cyclictest0-21swapper/219:27:042
14140996515,43cyclictest0-21swapper/221:03:532
14141996441,15cyclictest18673-21runrttasks17:48:513
14140996424,34cyclictest1765-21df20:21:482
14140996420,37cyclictest0-21swapper/218:01:572
14140996417,41cyclictest0-21swapper/222:00:422
14140996416,42cyclictest0-21swapper/222:11:522
14140996415,43cyclictest0-21swapper/222:22:122
1413999644,39cyclictest0-21swapper/122:23:501
14139996424,23cyclictest0-21swapper/122:06:421
219499630,7rtkit-daemon0-21swapper/019:11:461
14140996316,40cyclictest0-21swapper/220:40:112
14140996315,43cyclictest0-21swapper/222:43:432
14140996218,38cyclictest0-21swapper/221:16:532
14140996217,39cyclictest27441-21munin-node19:16:562
14140996217,39cyclictest21683-21chrt22:30:052
14139996234,12cyclictest0-21swapper/122:14:391
219499610,6rtkit-daemon4756-21grep18:27:031
14140996117,38cyclictest1227-21runrttasks20:46:032
1413999614,35cyclictest0-21swapper/121:44:221
14140996016,38cyclictest0-21swapper/218:37:102
14140996015,39cyclictest6895-21awk19:41:332
14140996015,39cyclictest28962-21cpuspeed_turbos18:11:512
14140996015,39cyclictest28962-21cpuspeed_turbos18:11:512
14140995919,36cyclictest0-21swapper/217:41:392
14140995914,40cyclictest0-21swapper/218:16:472
14140995911,42cyclictest0-21swapper/218:51:472
14141995828,13cyclictest14333-21cat17:41:403
1414099589,43cyclictest0-21swapper/219:11:112
14140995717,34cyclictest6098-21aten_r1power_vo18:31:492
14140995716,36cyclictest0-21swapper/218:21:492
219499560,6rtkit-daemon2193-21rtkit-daemon18:07:032
14140995633,15cyclictest1227-21runrttasks18:29:132
14140995632,16cyclictest1227-21runrttasks18:45:092
14140995617,34cyclictest0-21swapper/219:32:052
14140995534,14cyclictest1227-21runrttasks19:02:582
14140995534,14cyclictest1227-21runrttasks19:02:582
14140995531,16cyclictest1227-21runrttasks17:44:042
14140995517,33cyclictest31983-21latency_hist19:26:342
1413999544,32cyclictest0-21swapper/118:01:571
14139995416,11cyclictest1227-21runrttasks22:28:481
59382534,42sleep00-21swapper/018:31:440
14139995333,12cyclictest14248-21unixbench_singl22:17:021
14139995322,13cyclictest0-21swapper/123:06:491
14139995322,13cyclictest0-21swapper/117:57:011
1413999524,35cyclictest0-21swapper/120:02:571
1413999524,31cyclictest0-21swapper/122:32:001
1413499524,29cyclictest0-21swapper/018:56:520
1413499524,29cyclictest0-21swapper/018:56:520
165002513,41sleep10-21swapper/117:46:361
1413999515,28cyclictest0-21swapper/120:06:551
1413999515,28cyclictest0-21swapper/117:52:121
1413999505,28cyclictest0-21swapper/118:07:121
1413999504,28cyclictest0-21swapper/120:11:431
14139995011,9cyclictest0-21swapper/121:17:121
1413999494,28cyclictest0-21swapper/117:47:011
1413499494,39cyclictest0-21swapper/018:06:520
1413499484,27cyclictest0-21swapper/018:26:590
1413499484,26cyclictest0-21swapper/018:47:060
1413999474,27cyclictest0-21swapper/118:36:471
1413499474,26cyclictest0-21swapper/019:33:350
1413499474,26cyclictest0-21swapper/019:06:560
1413499464,25cyclictest0-21swapper/019:38:360
1413999382,23cyclictest0-21swapper/117:41:391
137882376,25sleep00-21swapper/017:37:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional