You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 07:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Dec 10, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2437991060,9rtkit-daemon0-21swapper/023:37:300
320419910326,35cyclictest0-21swapper/218:57:562
320419910242,15cyclictest0-21swapper/221:27:352
32037998135,38cyclictest1369-21runrttasks21:58:050
243799790,4rtkit-daemon2436-21rtkit-daemon22:47:401
243799750,8rtkit-daemon0-21swapper/123:58:593
243799740,12rtkit-daemon21-21ksoftirqd/120:54:593
284712710,4sleep128469-21cat00:12:101
32037996944,18cyclictest9631-21processes20:07:470
243799690,11rtkit-daemon0-21swapper/020:38:070
32037996823,37cyclictest25574-21grep19:32:570
32037996716,31cyclictest0-21swapper/021:02:340
32037996639,20cyclictest18645-21taskset21:35:460
32037996614,34cyclictest0-21swapper/021:27:520
243799660,8rtkit-daemon0-21swapper/123:59:220
32037996523,35cyclictest12302-21grep22:27:490
243799650,7rtkit-daemon0-21swapper/120:43:590
243799650,6rtkit-daemon31572-21users20:52:520
243799650,4rtkit-daemon2436-21rtkit-daemon19:18:330
32041996428,29cyclictest0-21swapper/218:42:422
32037996414,34cyclictest0-21swapper/019:52:440
32037996413,43cyclictest0-21swapper/022:07:150
243799640,7rtkit-daemon21-21ksoftirqd/123:35:000
243799640,6rtkit-daemon6308-21sed21:07:510
243799640,5rtkit-daemon7604-21users22:17:480
32037996324,32cyclictest12693-21grep21:22:360
32037996314,34cyclictest1243-21snmpd20:17:330
32037996314,34cyclictest1243-21snmpd20:17:330
32037996313,42cyclictest0-21swapper/022:37:150
32037996313,32cyclictest0-21swapper/019:02:540
32037996310,45cyclictest0-21swapper/019:12:410
243799630,9rtkit-daemon0-21swapper/120:59:593
243799630,9rtkit-daemon0-21swapper/120:59:593
243799630,7rtkit-daemon0-21swapper/121:53:120
243799630,10rtkit-daemon0-21swapper/121:40:350
243799630,10rtkit-daemon0-21swapper/121:40:350
3204199624,46cyclictest0-21swapper/221:52:462
32037996243,14cyclictest1243-21snmpd22:47:050
32037996216,39cyclictest0-21swapper/023:42:420
32037996216,29cyclictest0-21swapper/019:42:450
32037996215,39cyclictest22303-21crond22:52:120
32037996215,26cyclictest27266-21iostat_ios19:37:450
32037996210,44cyclictest0-21swapper/018:52:430
32037996210,44cyclictest0-21swapper/018:52:430
243799620,6rtkit-daemon26818-21perl00:07:290
243799620,6rtkit-daemon18-21rcuc/123:17:230
243799620,5rtkit-daemon9005-21gltestperf22:22:330
243799620,5rtkit-daemon9005-21gltestperf22:22:330
243799620,5rtkit-daemon1491-21df_inode22:07:340
32037996114,40cyclictest0-21swapper/020:57:320
32037996114,40cyclictest0-21swapper/020:57:320
32037996114,40cyclictest0-21swapper/020:47:450
32037996112,30cyclictest0-21swapper/019:27:500
32037996111,32cyclictest0-21swapper/019:08:150
243799610,6rtkit-daemon17436-21expr23:47:300
243799610,5rtkit-daemon2436-21rtkit-daemon23:02:462
243799610,5rtkit-daemon2436-21rtkit-daemon23:02:462
243799610,5rtkit-daemon2436-21rtkit-daemon22:27:332
243799610,14rtkit-daemon2436-21rtkit-daemon18:42:570
3204299606,39cyclictest0-21swapper/319:37:233
3203799607,35cyclictest0-21swapper/021:47:310
32037996021,32cyclictest1369-21runrttasks21:17:260
32037996017,35cyclictest2320-21munin-node18:47:470
32037996014,30cyclictest0-21swapper/023:12:340
32037996013,40cyclictest0-21swapper/000:02:230
29372603,49sleep30-21swapper/318:47:423
32041995941,12cyclictest0-21swapper/221:12:272
32037995916,35cyclictest18940-21munin-node23:52:230
32037995913,29cyclictest0-21swapper/020:24:580
32037995911,41cyclictest0-21swapper/019:22:320
32042995838,12cyclictest12025-21sendmail_mailst22:27:463
32042995817,33cyclictest1369-21runrttasks20:42:323
32040995841,9cyclictest15037-21gltestperf21:27:371
32037995834,16cyclictest32035-21awk18:42:220
32037995815,21cyclictest0-21swapper/020:34:110
32037995813,38cyclictest0-21swapper/019:47:570
32037995812,39cyclictest0-21swapper/023:27:180
32037995812,29cyclictest0-21swapper/019:58:230
32042995738,12cyclictest5876-21needreboot21:07:433
32042995723,12cyclictest0-21swapper/320:22:183
32042995723,12cyclictest0-21swapper/320:22:183
32037995724,16cyclictest0-21swapper/018:57:460
32037995711,30cyclictest0-21swapper/020:12:320
32042995625,13cyclictest0-21swapper/323:32:053
32041995615,33cyclictest0-21swapper/221:17:292
3204099564,28cyclictest0-21swapper/119:05:011
32037995627,22cyclictest0-21swapper/022:37:180
32042995538,9cyclictest12058-21tail19:07:353
3204199554,45cyclictest0-21swapper/220:42:182
3204199554,43cyclictest0-21swapper/222:27:142
3204199554,43cyclictest0-21swapper/222:27:142
32037995522,26cyclictest0-21swapper/023:09:360
32037995515,15cyclictest0-21swapper/020:02:310
32037995511,28cyclictest0-21swapper/020:27:430
299282553,10sleep130048-21ls20:52:311
190872554,12sleep30-21swapper/320:27:503
32042995433,13cyclictest0-21swapper/323:37:123
32042995425,21cyclictest25581-21unixbench_singl19:32:573
3204199544,42cyclictest0-21swapper/221:32:412
32041995433,13cyclictest0-21swapper/222:02:142
32041995431,16cyclictest0-21swapper/220:17:352
32041995431,16cyclictest0-21swapper/220:17:352
3204199543,45cyclictest0-21swapper/200:02:322
3204099544,31cyclictest0-21swapper/123:52:361
3204099544,31cyclictest0-21swapper/123:17:121
3204099544,14cyclictest0-21swapper/100:04:321
3203799549,31cyclictest0-21swapper/021:44:000
3203799549,31cyclictest0-21swapper/021:44:000
32037995435,12cyclictest1369-21runrttasks23:24:070
243799540,4rtkit-daemon2436-21rtkit-daemon23:08:462
243799540,4rtkit-daemon2436-21rtkit-daemon22:41:102
243799540,4rtkit-daemon2436-21rtkit-daemon22:32:182
167742543,9sleep116932-21cstates23:47:241
32042995334,11cyclictest9786-21cut21:17:303
32041995337,11cyclictest0-21swapper/222:17:262
32041995332,14cyclictest0-21swapper/223:12:262
32041995330,18cyclictest0-21swapper/220:32:552
32041995320,8cyclictest1369-21runrttasks23:17:192
3204099535,30cyclictest0-21swapper/118:53:121
3204099535,30cyclictest0-21swapper/118:53:121
3204099534,31cyclictest0-21swapper/121:12:351
3204099534,30cyclictest0-21swapper/123:37:431
3203799536,40cyclictest0-21swapper/022:12:250
3203799535,34cyclictest0-21swapper/023:04:210
3203799535,34cyclictest0-21swapper/023:04:210
32037995315,32cyclictest0-21swapper/022:54:180
243799530,4rtkit-daemon2436-21rtkit-daemon22:44:102
3204199523,42cyclictest3433-21munin-node22:12:532
3204099525,28cyclictest0-21swapper/120:32:521
3204099524,29cyclictest0-21swapper/119:12:561
3204099524,27cyclictest0-21swapper/120:57:571
3204099524,27cyclictest0-21swapper/120:57:571
3204099524,13cyclictest0-21swapper/120:17:321
3204099524,13cyclictest0-21swapper/120:17:321
32040995219,13cyclictest0-21swapper/120:22:561
31342522,43sleep10-21swapper/118:47:441
3204299517,27cyclictest0-21swapper/300:07:373
3204299515,28cyclictest0-21swapper/323:17:253
3204299515,28cyclictest0-21swapper/323:07:343
32042995132,12cyclictest26291-21tail21:52:283
32042995125,8cyclictest23542-21latency_hist21:47:163
32042995125,8cyclictest23542-21latency_hist21:47:163
3204199514,39cyclictest0-21swapper/222:57:312
3204199514,29cyclictest0-21swapper/221:22:292
3204199514,29cyclictest0-21swapper/221:02:432
3204199514,29cyclictest0-21swapper/220:07:372
32041995134,10cyclictest5544-21grep21:07:382
3204099514,29cyclictest0-21swapper/122:27:401
3204099514,29cyclictest0-21swapper/121:42:381
3204099514,29cyclictest0-21swapper/121:42:381
3204099514,29cyclictest0-21swapper/120:37:461
3204099514,29cyclictest0-21swapper/119:17:451
3204099514,28cyclictest0-21swapper/123:42:251
3204099514,28cyclictest0-21swapper/123:02:471
3204099514,28cyclictest0-21swapper/123:02:471
3204099514,28cyclictest0-21swapper/120:07:491
3204099514,27cyclictest0-21swapper/121:37:111
3204099513,29cyclictest0-21swapper/121:47:321
32040995121,13cyclictest0-21swapper/119:42:411
32040995121,12cyclictest0-21swapper/123:57:251
32037995119,19cyclictest7079-21aten2.4-expect21:12:270
31112512,9sleep10-21swapper/119:55:151
292712512,41sleep10-21swapper/120:48:441
243799510,6rtkit-daemon2436-21rtkit-daemon23:12:463
210042512,42sleep10-21swapper/121:40:241
210042512,42sleep10-21swapper/121:40:241
3204299505,12cyclictest0-21swapper/319:13:163
3204299504,38cyclictest0-21swapper/323:52:413
3204299504,28cyclictest0-21swapper/319:22:553
3204199505,25cyclictest0-21swapper/223:47:212
3204199504,28cyclictest0-21swapper/219:52:212
3204199504,28cyclictest0-21swapper/219:37:582
32041995034,11cyclictest0-21swapper/220:57:322
32041995034,11cyclictest0-21swapper/220:57:322
32041995032,11cyclictest24971-21grep19:32:482
32041995030,14cyclictest0-21swapper/222:02:522
3204099504,28cyclictest0-21swapper/123:22:381
3204099504,28cyclictest0-21swapper/123:07:441
3204099504,28cyclictest0-21swapper/122:52:331
3204099504,28cyclictest0-21swapper/122:42:471
3204099504,28cyclictest0-21swapper/122:02:371
3204099504,28cyclictest0-21swapper/121:52:441
3204099504,28cyclictest0-21swapper/119:42:201
3204099504,28cyclictest0-21swapper/119:22:401
3204099504,27cyclictest0-21swapper/122:07:291
3204099503,34cyclictest0-21swapper/123:37:101
3204099503,27cyclictest0-21swapper/121:12:181
32040995021,12cyclictest0-21swapper/121:17:411
32040995019,13cyclictest0-21swapper/119:32:511
32040995018,14cyclictest0-21swapper/122:34:121
3203799504,38cyclictest0-21swapper/022:57:330
3204299495,22cyclictest0-21swapper/321:37:283
3204299495,22cyclictest0-21swapper/321:37:283
3204299494,36cyclictest0-21swapper/320:02:313
3204299494,28cyclictest0-21swapper/320:22:393
3204299494,28cyclictest0-21swapper/319:47:533
3204299494,28cyclictest0-21swapper/318:57:433
3204199494,38cyclictest0-21swapper/219:27:522
3204199494,28cyclictest0-21swapper/222:47:392
3204199494,27cyclictest0-21swapper/223:59:312
3204199494,25cyclictest0-21swapper/223:52:302
3204099494,28cyclictest0-21swapper/122:12:361
3204099494,28cyclictest0-21swapper/120:02:421
3204099494,27cyclictest0-21swapper/119:57:461
3204099494,26cyclictest0-21swapper/122:19:051
3204099494,26cyclictest0-21swapper/120:43:431
317082492,9sleep20-21swapper/220:54:212
199622492,9sleep10-21swapper/120:32:161
138672492,9sleep10-21swapper/121:25:561
54042482,9sleep30-21swapper/319:59:043
3204299484,36cyclictest0-21swapper/320:37:253
32042994828,13cyclictest0-21swapper/322:37:153
32042994828,12cyclictest1015-21crond21:37:153
32042994826,15cyclictest0-21swapper/322:42:343
32042994826,14cyclictest0-21swapper/321:02:443
32042994822,19cyclictest23741-21needreboot22:52:393
3204199484,28cyclictest0-21swapper/220:22:452
3204199484,27cyclictest0-21swapper/223:33:332
3204199484,27cyclictest0-21swapper/221:42:302
3204199484,27cyclictest0-21swapper/221:42:302
3204199484,27cyclictest0-21swapper/220:17:192
3204199484,26cyclictest0-21swapper/218:57:232
3204199484,26cyclictest0-21swapper/218:57:232
3204199484,24cyclictest0-21swapper/219:57:192
32041994819,12cyclictest0-21swapper/220:47:352
32041994810,31cyclictest30100-21switchtime19:42:552
3204099484,28cyclictest0-21swapper/120:13:371
3204099484,27cyclictest0-21swapper/122:57:471
3204099484,23cyclictest0-21swapper/118:42:341
3204099483,28cyclictest0-21swapper/119:07:411
32040994818,12cyclictest0-21swapper/119:47:561
32040994817,13cyclictest0-21swapper/123:27:421
32040994817,13cyclictest0-21swapper/121:02:421
163862482,9sleep20-21swapper/219:16:472
58132472,38sleep30-21swapper/322:17:223
53962472,9sleep20-21swapper/219:58:592
42692472,39sleep10-21swapper/123:21:121
3204299476,34cyclictest0-21swapper/320:47:303
3204299475,33cyclictest0-21swapper/323:37:133
3204299474,35cyclictest0-21swapper/320:37:203
3204299474,26cyclictest0-21swapper/319:02:383
3204299474,13cyclictest0-21swapper/318:52:433
3204299474,13cyclictest0-21swapper/318:52:433
3204299473,37cyclictest361ktimersoftd/323:47:323
3204299472,19cyclictest0-21swapper/320:07:403
3204199474,34cyclictest0-21swapper/223:22:232
3204199474,26cyclictest0-21swapper/223:44:262
32041994733,10cyclictest0-21swapper/200:07:232
3204199473,37cyclictest0-21swapper/223:27:412
32041994727,14cyclictest0-21swapper/221:47:432
32041994719,12cyclictest0-21swapper/221:37:442
32041994719,12cyclictest0-21swapper/221:37:442
3204099474,26cyclictest0-21swapper/122:37:261
231462472,38sleep10-21swapper/119:27:551
136422472,9sleep20-21swapper/223:38:312
128042472,39sleep30-21swapper/320:17:143
3204299465,13cyclictest0-21swapper/323:02:433
3204299465,13cyclictest0-21swapper/323:02:433
3204299464,33cyclictest0-21swapper/319:47:213
3204299464,13cyclictest0-21swapper/319:52:253
32042994625,14cyclictest0-21swapper/321:31:003
32042994622,18cyclictest1369-21runrttasks23:46:533
32042994618,12cyclictest0-21swapper/321:59:023
3204199464,36cyclictest0-21swapper/219:22:492
3204199464,35cyclictest0-21swapper/220:27:322
3204199464,35cyclictest0-21swapper/220:02:422
3204199464,25cyclictest0-21swapper/222:52:272
3204199463,37cyclictest0-21swapper/222:07:492
3204099463,26cyclictest0-21swapper/118:58:131
300792464,34sleep20-21swapper/218:37:392
267882462,9sleep30-21swapper/322:58:293
258082462,9sleep30-21swapper/321:50:453
256912462,9sleep30-21swapper/300:05:003
222502462,38sleep30-21swapper/322:51:363
100802462,9sleep30-21swapper/322:23:433
100802462,9sleep30-21swapper/322:23:433
100382462,9sleep10-21swapper/122:23:081
100382462,9sleep10-21swapper/122:23:081
44662452,36sleep30-21swapper/322:12:383
3204299454,34cyclictest0-21swapper/322:02:453
3204299454,24cyclictest0-21swapper/319:17:463
32042994527,11cyclictest1221-21tr22:07:313
32042994519,20cyclictest1015-21crond19:32:203
3204199454,23cyclictest0-21swapper/219:02:342
32041994531,8cyclictest17417-21grep19:17:402
32041994518,12cyclictest0-21swapper/220:42:322
3204099454,22cyclictest0-21swapper/121:57:281
174142452,37sleep30-21swapper/322:40:443
3204299444,32cyclictest0-21swapper/323:27:123
3204299444,12cyclictest0-21swapper/318:47:233
32042994421,16cyclictest0-21swapper/321:12:423
3204199444,33cyclictest0-21swapper/219:12:012
3204199444,13cyclictest0-21swapper/218:47:402
139362442,35sleep30-21swapper/321:26:513
3204299324,22cyclictest32215-21latency_hist18:42:233
3204099319,13cyclictest0-21swapper/118:42:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional