You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 09:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun Aug 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30221991103,100cyclictest935-21cpu20:10:522
30216991064,52cyclictest1227-21runrttasks21:31:100
30216991064,52cyclictest1227-21runrttasks21:31:100
2938721040,26sleep20-21swapper/222:30:532
30216991034,52cyclictest0-21swapper/022:37:070
30216991034,51cyclictest8053-21taskset21:10:370
30216991014,50cyclictest0-21swapper/021:26:010
30221991009,10cyclictest7150irq/45-ahci21:35:162
30221991009,10cyclictest7150irq/45-ahci21:35:162
3021699994,53cyclictest0-21swapper/023:15:540
30220999831,12cyclictest0-21swapper/121:36:071
3021699974,50cyclictest0-21swapper/020:31:060
3021699964,46cyclictest21129-21df20:40:530
3022199953,47cyclictest0-21swapper/221:09:222
30220999524,23cyclictest0-21swapper/119:26:031
219499950,5rtkit-daemon2193-21rtkit-daemon20:11:113
30220999432,10cyclictest0-21swapper/121:47:451
3022199934,53cyclictest0-21swapper/220:16:052
3022199934,53cyclictest0-21swapper/220:16:052
30221999335,11cyclictest30877-21grep19:01:152
30220999313,29cyclictest0-21swapper/123:15:491
3022099923,41cyclictest0-21swapper/120:50:551
3022099923,41cyclictest0-21swapper/120:50:551
3022199915,40cyclictest1227-21runrttasks21:18:222
30221999138,11cyclictest21111-21grep19:50:542
3022199905,29cyclictest0-21swapper/221:40:422
3022199905,25cyclictest0-21swapper/222:16:172
3022199905,25cyclictest0-21swapper/222:16:172
30221999021,15cyclictest0-21swapper/221:55:522
3022199894,31cyclictest0-21swapper/220:56:082
3022099894,77cyclictest0-21swapper/122:35:491
3022199884,30cyclictest29669-21ssh20:05:402
3022099883,15cyclictest0-21swapper/119:55:561
3022099874,11cyclictest0-21swapper/121:10:361
30220998739,42cyclictest0-21swapper/122:41:511
30220998736,8cyclictest25367-21proc_pri20:46:101
30220998735,6cyclictest15539-21ssh23:00:001
30220998735,6cyclictest15539-21ssh23:00:001
30220998733,7cyclictest4260-21rm21:04:191
3022099873,35cyclictest0-21swapper/122:25:491
3022099872,37cyclictest384-21taskset20:57:431
30220998719,12cyclictest0-21swapper/123:05:331
3022199865,14cyclictest0-21swapper/222:10:562
3022199855,14cyclictest0-21swapper/222:50:252
3022099854,38cyclictest0-21swapper/119:41:051
3022099853,34cyclictest0-21swapper/120:25:511
3022199845,31cyclictest0-21swapper/219:59:542
3022099844,9cyclictest21762-21taskset23:08:381
30220998431,13cyclictest0-21swapper/121:16:071
3022099843,27cyclictest0-21swapper/121:55:561
3022299833,57cyclictest20618-21proc_pri23:06:023
3022299833,46cyclictest0-21swapper/321:47:153
30222998315,36cyclictest0-21swapper/322:37:173
30220998331,10cyclictest15337-21df_inode21:20:541
3022299824,58cyclictest0-21swapper/323:10:553
3022099824,38cyclictest0-21swapper/120:15:571
3022099824,38cyclictest0-21swapper/120:15:571
3022099824,11cyclictest0-21swapper/122:02:481
3022099823,37cyclictest0-21swapper/120:37:131
3022099823,36cyclictest0-21swapper/119:01:021
30220998227,12cyclictest0-21swapper/120:22:151
3022299813,70cyclictest11369-21munin-node18:21:113
3022299812,33cyclictest107550irq/46-eth020:37:233
30221998121,12cyclictest12274-21rm20:26:062
3022299804,66cyclictest2123-21diskstats21:00:543
3022299804,59cyclictest0-21swapper/323:00:453
3022299804,52cyclictest0-21swapper/320:01:023
30221998022,14cyclictest0-21swapper/219:21:042
3022099803,9cyclictest1124-21snmpd21:41:051
30220998029,13cyclictest0-21swapper/118:45:191
219499800,5rtkit-daemon2193-21rtkit-daemon21:56:453
3022099794,33cyclictest0-21swapper/123:15:321
30220997936,10cyclictest1742-21wc19:10:581
3022299784,53cyclictest0-21swapper/322:45:513
3022299783,68cyclictest22957-21diskmemload22:01:293
30220997827,10cyclictest0-21swapper/122:52:241
3022299773,57cyclictest1124-21snmpd20:16:383
3022299773,57cyclictest1124-21snmpd20:16:383
30220997733,7cyclictest31905-21ssh20:06:551
30220997730,11cyclictest0-21swapper/122:11:031
30220997728,12cyclictest0-21swapper/122:45:441
3022299765,63cyclictest0-21swapper/322:20:193
3022299765,63cyclictest0-21swapper/322:20:193
3022299764,65cyclictest0-21swapper/323:15:423
3022299764,65cyclictest0-21swapper/320:30:403
3022299764,52cyclictest0-21swapper/322:14:283
30222997611,42cyclictest0-21swapper/320:41:093
30221997642,12cyclictest0-21swapper/220:30:522
3022299754,55cyclictest1227-21runrttasks21:42:573
3022299754,54cyclictest0-21swapper/322:30:463
3022299754,52cyclictest0-21swapper/320:00:393
3022299754,51cyclictest0-21swapper/321:27:253
3022299753,63cyclictest16210-21ps21:21:073
30222997521,36cyclictest29083-21unixbench_singl20:51:103
30222997521,36cyclictest29083-21unixbench_singl20:51:103
3022099754,34cyclictest0-21swapper/121:15:371
3022099753,11cyclictest0-21swapper/122:20:321
3022099753,11cyclictest0-21swapper/122:20:321
221652750,5sleep122164-21cat22:20:481
41382740,7sleep10-21swapper/120:15:401
3022299747,36cyclictest22957-21diskmemload21:32:563
3022299747,36cyclictest22957-21diskmemload21:32:563
3022299744,54cyclictest0-21swapper/322:20:453
3022299744,54cyclictest0-21swapper/319:11:033
3022299743,53cyclictest1124-21snmpd18:45:553
3022299743,51cyclictest0-21swapper/322:05:583
30222997410,57cyclictest22957-21diskmemload22:57:473
30222997410,57cyclictest22957-21diskmemload22:57:473
30220997428,13cyclictest0-21swapper/119:15:561
30220997425,12cyclictest0-21swapper/118:30:431
219499740,4rtkit-daemon2193-21rtkit-daemon22:50:582
3022299734,55cyclictest0-21swapper/321:14:203
3022299734,52cyclictest0-21swapper/318:01:083
3022299733,62cyclictest1124-21snmpd21:38:023
3022299733,61cyclictest27619-21taskset22:28:163
3022299733,46cyclictest29881-21grep19:01:003
30220997331,7cyclictest4976-21rm21:54:391
30220997329,12cyclictest0-21swapper/118:13:181
30220997328,12cyclictest0-21swapper/123:20:581
219499730,4rtkit-daemon2193-21rtkit-daemon22:05:372
3022299724,61cyclictest0-21swapper/323:20:413
3022299724,61cyclictest0-21swapper/320:23:123
3022299723,62cyclictest0-21swapper/322:42:123
3022299723,62cyclictest0-21swapper/320:49:343
3022299722,63cyclictest12588-21wc21:16:003
30222997211,46cyclictest0-21swapper/320:05:523
30220997229,11cyclictest0-21swapper/118:00:141
30220997228,11cyclictest0-21swapper/120:42:031
3022299715,58cyclictest4497-21ssh21:52:483
3022299714,61cyclictest0-21swapper/322:52:513
3022299714,52cyclictest0-21swapper/321:06:093
3022299713,61cyclictest0-21swapper/320:56:153
3022299713,53cyclictest9433-21diskstats19:25:563
3022299713,48cyclictest0-21swapper/319:05:523
30222997116,38cyclictest53151munin-node18:11:163
3022299703,56cyclictest1080-21lldpd18:37:123
3022299703,52cyclictest1124-21snmpd18:30:553
3022299703,49cyclictest14106-21ssh20:30:493
30222997016,38cyclictest27241-21df18:55:573
30220997028,11cyclictest0-21swapper/122:33:331
3022299694,59cyclictest0-21swapper/319:50:503
3021699694,57cyclictest0-21swapper/022:45:500
30222996830,32cyclictest12853-21ls18:25:583
3022299683,58cyclictest30439-21munin-node17:55:593
3022299683,47cyclictest5104-21iostat_ios19:16:033
30220996829,10cyclictest0-21swapper/119:34:041
30220996829,10cyclictest0-21swapper/119:34:041
30220996828,11cyclictest0-21swapper/119:46:101
30220996822,11cyclictest0-21swapper/118:02:331
3022299673,57cyclictest3945-21sh18:06:063
3022299673,57cyclictest3945-21sh18:06:063
3022299673,49cyclictest20736-21latency18:41:083
3022199674,54cyclictest0-21swapper/220:23:172
219499670,5rtkit-daemon2193-21rtkit-daemon21:48:082
3022299664,54cyclictest0-21swapper/319:35:513
3022299663,47cyclictest8247-21chrt19:21:163
30222996620,40cyclictest12827-21timerandwakeup19:31:143
30222996620,40cyclictest12827-21timerandwakeup19:31:143
30220996627,13cyclictest0-21swapper/121:27:071
3021699665,54cyclictest32676-21python21:46:030
3021699664,31cyclictest0-21swapper/023:00:480
219499660,4rtkit-daemon2193-21rtkit-daemon19:10:062
3022299654,54cyclictest8916-21needreboot18:16:103
3022299654,42cyclictest0-21swapper/319:41:063
3021699654,55cyclictest0-21swapper/019:59:510
219499650,5rtkit-daemon2193-21rtkit-daemon22:37:512
219499650,4rtkit-daemon2193-21rtkit-daemon19:26:132
3022299643,37cyclictest0-21swapper/318:50:563
3022299643,37cyclictest0-21swapper/318:50:563
3021699644,54cyclictest0-21swapper/022:05:500
3021699644,53cyclictest0-21swapper/022:55:560
3021699644,53cyclictest0-21swapper/022:55:560
3021699644,53cyclictest0-21swapper/019:55:390
219499640,5rtkit-daemon2193-21rtkit-daemon22:22:442
219499640,5rtkit-daemon2193-21rtkit-daemon20:36:552
219499640,4rtkit-daemon2193-21rtkit-daemon21:04:092
3021699634,53cyclictest0-21swapper/020:01:090
3021699634,52cyclictest0-21swapper/023:21:010
3021699634,52cyclictest0-21swapper/021:50:520
3021699634,52cyclictest0-21swapper/020:45:560
219499630,5rtkit-daemon2193-21rtkit-daemon20:46:102
219499630,4rtkit-daemon2193-21rtkit-daemon21:50:382
219499630,4rtkit-daemon2193-21rtkit-daemon19:13:292
30222996223,33cyclictest1227-21runrttasks19:48:093
3021699625,51cyclictest0-21swapper/022:25:490
226712620,4sleep222790-21cpuspeed_turbos23:10:442
219499620,4rtkit-daemon2193-21rtkit-daemon21:22:162
219499620,4rtkit-daemon2193-21rtkit-daemon21:12:022
219499620,4rtkit-daemon2193-21rtkit-daemon19:15:592
219499620,10rtkit-daemon0-21swapper/222:02:372
3021699615,49cyclictest0-21swapper/018:45:550
3021699614,50cyclictest0-21swapper/022:41:060
3021699614,50cyclictest0-21swapper/022:00:540
3021699614,50cyclictest0-21swapper/020:21:120
3021699614,50cyclictest0-21swapper/020:16:000
3021699614,50cyclictest0-21swapper/020:16:000
3021699613,52cyclictest0-21swapper/021:01:090
3021699613,10cyclictest0-21swapper/021:37:070
219499610,10rtkit-daemon0-21swapper/220:08:122
3021699604,51cyclictest0-21swapper/021:10:480
3021699603,50cyclictest0-21swapper/022:21:030
3021699603,50cyclictest0-21swapper/018:56:110
3021699603,49cyclictest0-21swapper/022:20:000
3021699603,49cyclictest0-21swapper/022:20:000
3021699603,49cyclictest0-21swapper/020:56:110
219499600,8rtkit-daemon0-21swapper/219:30:512
219499600,8rtkit-daemon0-21swapper/219:30:512
219499600,10rtkit-daemon0-21swapper/222:43:432
3022199594,47cyclictest0-21swapper/223:20:472
3021699595,46cyclictest22533-21aten2.4-expect23:10:420
3021699594,49cyclictest0-21swapper/020:51:080
3021699594,49cyclictest0-21swapper/020:51:080
3021699594,47cyclictest13723-21head19:35:510
3021699593,50cyclictest0-21swapper/020:36:100
3021699593,50cyclictest0-21swapper/018:21:140
3021699593,49cyclictest28742-21tail21:40:570
113552596,11sleep00-21swapper/022:51:320
3021699585,47cyclictest0-21swapper/021:21:090
3021699584,48cyclictest0-21swapper/021:55:530
3021699583,50cyclictest0-21swapper/019:01:120
3021699583,49cyclictest0-21swapper/019:15:400
3021699583,48cyclictest0-21swapper/019:46:110
3021699583,48cyclictest0-21swapper/018:36:060
30216995814,38cyclictest0-21swapper/018:26:010
3022199575,15cyclictest0-21swapper/222:30:272
3022199574,47cyclictest12252-21awk18:25:432
30221995723,14cyclictest0-21swapper/220:41:052
3021699573,48cyclictest0-21swapper/020:30:320
3021699573,48cyclictest0-21swapper/020:14:390
3021699573,47cyclictest0-21swapper/019:31:470
3021699573,47cyclictest0-21swapper/019:31:470
3021699573,46cyclictest0-21swapper/022:30:410
3021699573,11cyclictest0-21swapper/021:20:200
30216995722,28cyclictest16209-21gltestperf22:10:540
277262570,6sleep227725-21df20:50:522
277262570,6sleep227725-21df20:50:522
3022299564,46cyclictest0-21swapper/317:55:443
3022199565,29cyclictest0-21swapper/219:35:582
3022199565,27cyclictest0-21swapper/223:06:032
3021699564,46cyclictest0-21swapper/023:05:590
3021699564,45cyclictest4347-21sendmail_mailqu18:06:130
3021699564,45cyclictest4347-21sendmail_mailqu18:06:130
3021699563,47cyclictest0-21swapper/019:21:020
3021699563,46cyclictest31430-21cat20:06:120
3021699563,46cyclictest0-21swapper/018:01:080
30216995622,12cyclictest0-21swapper/019:26:070
3021699562,48cyclictest0-21swapper/018:11:010
3022199554,44cyclictest0-21swapper/222:59:492
3022199554,44cyclictest0-21swapper/222:59:492
3021699553,45cyclictest0-21swapper/019:05:550
3022199545,29cyclictest0-21swapper/218:35:572
3022199544,30cyclictest0-21swapper/218:26:012
3022199544,29cyclictest0-21swapper/223:00:502
3022199544,27cyclictest0-21swapper/218:59:272
3022199543,28cyclictest0-21swapper/218:12:232
30220995430,19cyclictest0-21swapper/118:24:191
3021699543,45cyclictest0-21swapper/018:44:220
3021699543,45cyclictest0-21swapper/018:16:020
3022199535,29cyclictest22083-21aten2.4-expect18:45:552
3022199535,28cyclictest0-21swapper/218:41:002
3022199534,29cyclictest0-21swapper/218:31:052
3022199534,27cyclictest18224-21cpu21:25:492
30221995321,13cyclictest0-21swapper/219:41:012
30221995320,13cyclictest0-21swapper/221:35:542
30220995337,10cyclictest21124-21tr19:50:541
3021699533,44cyclictest0-21swapper/018:51:020
3021699533,44cyclictest0-21swapper/018:51:020
3021699533,10cyclictest0-21swapper/019:15:550
3021699532,45cyclictest0-21swapper/018:35:430
219499530,5rtkit-daemon2193-21rtkit-daemon17:51:022
3022199525,28cyclictest0-21swapper/223:15:502
3022199525,28cyclictest0-21swapper/217:56:152
3022199524,29cyclictest0-21swapper/218:15:512
3022199524,28cyclictest0-21swapper/218:05:572
3022199524,28cyclictest0-21swapper/218:05:572
30220995239,8cyclictest13791-21runrttasks19:35:511
30220995235,11cyclictest0-21swapper/118:31:101
3021699523,43cyclictest0-21swapper/019:40:530
30221995110,34cyclictest26241-21sshd18:51:262
30221995110,34cyclictest26241-21sshd18:51:262
3022199504,29cyclictest0-21swapper/218:01:072
30220995023,13cyclictest0-21swapper/122:10:341
3022199497,25cyclictest4930-1kworker/2:0H19:45:572
3022099494,39cyclictest0-21swapper/118:50:421
30220994935,8cyclictest22583-21cut21:31:031
30220994935,8cyclictest22583-21cut21:31:031
3021699494,39cyclictest0-21swapper/017:56:040
301332494,6sleep00-21swapper/017:55:050
30220994835,8cyclictest7728-21aten_r1power_cu18:15:561
30220994832,11cyclictest0-21swapper/118:50:541
30220994832,11cyclictest0-21swapper/118:50:541
3022099483,38cyclictest0-21swapper/119:20:561
30220994823,11cyclictest0-21swapper/120:01:091
3022099474,35cyclictest0-21swapper/120:30:571
30220994732,11cyclictest0-21swapper/119:06:011
30220994624,11cyclictest0-21swapper/118:56:141
192442465,35sleep10-21swapper/118:38:431
30220994329,10cyclictest0-21swapper/118:06:201
30220994329,10cyclictest0-21swapper/118:06:201
30220993717,14cyclictest0-21swapper/117:55:441
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional