You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 06:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 26, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
301199260,25cyclictest29076-21diskmemload23:54:393
301199250,24cyclictest606-21dbus-daemon23:25:003
301199250,24cyclictest29076-21diskmemload21:52:003
301199250,24cyclictest0-21swapper/321:41:463
3008992525,0cyclictest0-21swapper/221:44:352
3008992523,1cyclictest0-21swapper/222:52:292
3007992523,1cyclictest8838-21tail00:30:381
300699250,1cyclictest15942-21ssh21:59:460
3011992423,0cyclictest29076-21diskmemload00:08:563
301199240,23cyclictest0-21swapper/323:14:523
301199240,23cyclictest0-21swapper/321:48:493
3008992423,1cyclictest0-21swapper/222:47:292
3008992422,1cyclictest26130-21if_eno122:40:382
3008992421,2cyclictest17895-21munin-plugin-st23:05:012
300899240,2cyclictest19730-21munin-run00:10:002
300899240,23cyclictest29076-21diskmemload22:11:042
300899240,23cyclictest15053-21perf19:35:002
300899240,23cyclictest0-21swapper/223:35:482
300899240,23cyclictest0-21swapper/200:38:472
300899240,23cyclictest0-21swapper/200:33:552
300899240,1cyclictest0-21swapper/222:28:362
300899240,1cyclictest0-21swapper/220:50:342
3007992423,1cyclictest0-21swapper/123:27:471
300799240,24cyclictest26397-21ssh23:11:421
300799240,24cyclictest0-21swapper/121:30:011
300799240,24cyclictest0-21swapper/121:23:391
300799240,23cyclictest0-21swapper/123:00:041
300799240,23cyclictest0-21swapper/122:50:231
300799240,23cyclictest0-21swapper/119:55:351
300799240,1cyclictest32412-21ssh21:43:461
300799240,1cyclictest25367-21ssh21:36:221
300799240,0cyclictest0-21swapper/122:40:231
300799240,0cyclictest0-21swapper/122:17:161
3006992423,1cyclictest29076-21diskmemload23:49:090
3006992422,1cyclictest11767-21ssh23:30:180
3006992421,2cyclictest19851-21perf19:45:010
300699240,24cyclictest0-21swapper/022:22:270
300699240,1cyclictest0-21swapper/000:21:210
300699240,0cyclictest22354-21ssh22:36:020
3011992323,0cyclictest29076-21diskmemload23:57:563
3011992323,0cyclictest0-21swapper/322:54:553
3011992323,0cyclictest0-21swapper/322:28:223
3011992323,0cyclictest0-21swapper/322:18:593
3011992321,1cyclictest0-21swapper/323:30:083
3011992321,1cyclictest0-21swapper/321:16:153
301199230,23cyclictest0-21swapper/323:05:103
301199230,23cyclictest0-21swapper/321:20:553
301199230,22cyclictest7574-21turbostat00:30:013
301199230,22cyclictest7574-21turbostat00:30:013
301199230,22cyclictest29076-21diskmemload21:30:103
301199230,22cyclictest29076-21diskmemload00:02:163
301199230,22cyclictest16292-21sh23:02:233
301199230,0cyclictest0-21swapper/323:42:573
301199230,0cyclictest0-21swapper/322:59:433
301199230,0cyclictest0-21swapper/322:42:143
3008992323,0cyclictest0-21swapper/223:08:532
3008992323,0cyclictest0-21swapper/222:39:002
3008992323,0cyclictest0-21swapper/221:51:002
3008992323,0cyclictest0-21swapper/221:37:112
3008992322,1cyclictest0-21swapper/221:55:242
3008992322,1cyclictest0-21swapper/221:19:552
3008992321,1cyclictest0-21swapper/222:32:022
3008992321,1cyclictest0-21swapper/221:27:292
3008992320,3cyclictest0-21swapper/200:00:502
3008992320,2cyclictest24183-21sh22:05:562
300899230,23cyclictest0-21swapper/200:16:372
300899230,22cyclictest6951-21apt-get20:25:342
300899230,22cyclictest10601-21ssh22:56:262
300899230,22cyclictest0-21swapper/221:31:382
300899230,0cyclictest32214-21ssh23:18:012
300899230,0cyclictest29076-21diskmemload23:40:212
300899230,0cyclictest0-21swapper/222:01:082
300899230,0cyclictest0-21swapper/200:21:092
3007992323,0cyclictest29076-21diskmemload00:03:061
3007992323,0cyclictest0-21swapper/122:27:571
3007992323,0cyclictest0-21swapper/121:57:361
3007992323,0cyclictest0-21swapper/121:50:361
3007992323,0cyclictest0-21swapper/100:17:021
3007992321,2cyclictest8686-21ssh23:58:521
3007992321,1cyclictest22242-21sh19:50:011
300799230,23cyclictest0-21swapper/121:46:161
300799230,22cyclictest28872-21ssh23:15:221
300799230,22cyclictest22529-21ssh23:08:461
300799230,22cyclictest19723-21ssh22:02:431
300799230,22cyclictest18902-21sh00:08:501
300799230,22cyclictest11613-21sh23:30:041
300799230,22cyclictest0-21swapper/100:25:381
300799230,22cyclictest0-21swapper/100:25:381
300799230,1cyclictest1201-21ssh00:22:551
300799230,0cyclictest0-21swapper/123:48:311
300799230,0cyclictest0-21swapper/123:42:461
300799230,0cyclictest0-21swapper/122:10:281
300799230,0cyclictest0-21swapper/121:26:191
300799230,0cyclictest0-21swapper/100:37:191
300699234,19cyclictest62550irq/127-eno122:15:220
3006992323,0cyclictest62550irq/127-eno100:19:230
3006992323,0cyclictest29076-21diskmemload21:46:400
3006992323,0cyclictest29076-21diskmemload21:15:560
3006992323,0cyclictest27245-21ssh21:39:210
3006992322,1cyclictest62550irq/127-eno123:21:510
3006992321,1cyclictest3652-21diskstats22:50:350
3006992321,1cyclictest0-21swapper/023:52:340
3006992320,2cyclictest12624-21cron19:30:000
300699230,23cyclictest0-21swapper/022:05:440
300699230,22cyclictest9477-40mandb00:00:000
300699230,22cyclictest9007-21ssh23:26:180
300699230,22cyclictest29076-21diskmemload21:33:270
300699230,22cyclictest19106-21ssh00:09:080
300699230,22cyclictest12311-21ssh00:01:220
300699230,22cyclictest0-21swapper/021:50:390
300699230,22cyclictest0-21swapper/021:00:000
300699230,1cyclictest28257-21sh22:42:250
300699230,1cyclictest20323-21sh22:03:360
300699230,0cyclictest29076-21diskmemload22:55:530
300699230,0cyclictest0-21swapper/022:25:510
300699230,0cyclictest0-21swapper/000:33:480
3011992222,0cyclictest29076-21diskmemload22:33:013
3011992222,0cyclictest0-21swapper/322:22:113
3011992222,0cyclictest0-21swapper/300:20:253
3011992221,1cyclictest15141-21ssh00:35:463
3011992220,1cyclictest20330-21apt-get22:35:353
3011992220,1cyclictest0-21swapper/322:00:473
3011992220,1cyclictest0-21swapper/319:35:003
3011992220,1cyclictest0-21swapper/300:15:013
3011992219,2cyclictest16979-21rm23:35:313
301199220,22cyclictest0-21swapper/322:05:523
301199220,21cyclictest29076-21diskmemload00:30:133
301199220,21cyclictest0-21swapper/323:45:343
301199220,21cyclictest0-21swapper/323:26:293
301199220,21cyclictest0-21swapper/322:12:263
301199220,21cyclictest0-21swapper/321:37:543
301199220,21cyclictest0-21swapper/321:11:123
301199220,21cyclictest0-21swapper/320:15:343
301199220,21cyclictest0-21swapper/320:00:353
301199220,21cyclictest0-21swapper/300:14:233
301199220,1cyclictest606-21dbus-daemon19:45:013
301199220,1cyclictest0-21swapper/323:18:453
301199220,1cyclictest0-21swapper/321:25:363
3008992222,0cyclictest0-21swapper/200:25:482
3008992222,0cyclictest0-21swapper/200:25:482
3008992221,1cyclictest4252-21perf20:20:002
3008992221,1cyclictest0-21swapper/222:21:142
3008992220,1cyclictest1687-21apt-get23:20:342
3008992220,1cyclictest11971-21apt-get23:30:332
3008992220,1cyclictest0-21swapper/223:55:252
3008992220,1cyclictest0-21swapper/221:45:482
300899220,21cyclictest12630-21apt19:30:002
300899220,21cyclictest0-21swapper/223:25:022
300899220,21cyclictest0-21swapper/223:10:022
300899220,21cyclictest0-21swapper/222:15:232
300899220,21cyclictest0-21swapper/220:20:332
300899220,21cyclictest0-21swapper/200:10:062
300899220,1cyclictest14287-21latency_hist20:40:012
300899220,1cyclictest14287-21latency_hist20:40:012
300899220,1cyclictest0-21swapper/223:50:352
300899220,1cyclictest0-21swapper/221:11:002
300899220,1cyclictest0-21swapper/219:50:322
300899220,0cyclictest0-21swapper/221:20:042
3007992222,0cyclictest29076-21diskmemload21:18:581
3007992220,1cyclictest30288-21sh22:45:121
3007992220,1cyclictest24519-21sh22:06:351
3007992220,1cyclictest0-21swapper/122:32:261
3007992220,1cyclictest0-21swapper/100:10:401
300799220,22cyclictest9095-21ssh22:24:161
300799220,22cyclictest0-21swapper/123:52:341
300799220,22cyclictest0-21swapper/123:23:231
300799220,21cyclictest29665-21sh21:10:301
300799220,21cyclictest0-21swapper/120:50:331
300799220,21cyclictest0-21swapper/120:40:341
300799220,1cyclictest11031-21ssh22:57:051
3006992221,1cyclictest0-21swapper/023:05:330
300699220,22cyclictest0-21swapper/023:15:190
300699220,22cyclictest0-21swapper/000:35:190
300699220,21cyclictest26272-21ssh23:11:310
300699220,21cyclictest22111-21apt-get23:40:350
300699220,21cyclictest13323-21ssh23:00:220
300699220,21cyclictest0-21swapper/023:35:090
300699220,21cyclictest0-21swapper/022:45:340
300699220,21cyclictest0-21swapper/022:10:330
300699220,21cyclictest0-21swapper/019:10:350
300699220,1cyclictest29620-21sh21:10:260
300699220,1cyclictest28605-21ssh21:40:310
300699220,1cyclictest0-21swapper/000:25:010
300699220,1cyclictest0-21swapper/000:25:010
300699220,0cyclictest62550irq/127-eno121:29:080
3011992121,0cyclictest0-21swapper/320:50:343
3011992120,1cyclictest31846-21perf20:10:003
3011992119,1cyclictest1649-21cron19:30:003
3011992119,1cyclictest0-21swapper/320:40:013
3011992119,1cyclictest0-21swapper/320:40:013
301199210,21cyclictest0-21swapper/321:55:273
301199210,21cyclictest0-21swapper/319:20:343
301199210,20cyclictest0-21swapper/320:55:023
301199210,20cyclictest0-21swapper/320:20:333
3008992120,1cyclictest0-21swapper/223:45:022
3008992119,1cyclictest14608-21apt-get20:40:342
3007992121,0cyclictest0-21swapper/120:05:331
300799210,21cyclictest0-21swapper/122:35:191
300799210,1cyclictest16792-21ssh23:35:141
3006992121,0cyclictest22543-21apt-get19:50:320
300699210,1cyclictest20059-21ssh00:10:120
300699210,0cyclictest9105-21apt-get20:30:020
300699210,0cyclictest4557-21apt-get20:20:330
301199200,19cyclictest26719-21cut21:05:003
3008992020,0cyclictest0-21swapper/220:30:022
3008992018,1cyclictest29460-21wc20:05:012
3008992018,1cyclictest29111-21munin-run21:10:002
300899200,0cyclictest0-21swapper/219:10:342
3007992020,0cyclictest21484-21apt-get20:55:021
3007992020,0cyclictest0-21swapper/120:20:331
3007992019,1cyclictest12940-21apt-get19:30:341
3007992019,1cyclictest11903-21munin-run20:35:011
3007992019,0cyclictest2128-21apt-get20:15:331
3006992020,0cyclictest12189-21apt-get20:35:320
3006992020,0cyclictest12189-21apt-get20:35:320
3011991919,0cyclictest0-21swapper/320:40:343
3011991919,0cyclictest0-21swapper/319:50:323
3011991918,1cyclictest3285-21apt-get19:10:343
3011991917,1cyclictest313-21systemd-journal20:15:003
3011991917,1cyclictest17450-21plymouth19:40:003
3008991918,1cyclictest29750-21apt-get20:05:332
3007991919,0cyclictest0-21swapper/120:35:321
3007991919,0cyclictest0-21swapper/120:35:321
3007991919,0cyclictest0-21swapper/120:00:341
3006991918,1cyclictest6951-21apt-get20:25:330
3006991918,0cyclictest0-21swapper/020:15:340
3006991917,1cyclictest606-21dbus-daemon20:55:010
3006991916,2cyclictest29446-21dump-pmu-power20:05:010
3011991817,1cyclictest0-21swapper/320:25:333
300899180,17cyclictest24606-21apt-get21:00:342
300899180,12cyclictest0-21swapper/219:40:342
3007991818,0cyclictest0-21swapper/119:10:351
3007991815,2cyclictest7774-21systemctl19:20:001
3006991818,0cyclictest8098-21apt-get19:20:340
3006991818,0cyclictest0-21swapper/021:05:340
3006991818,0cyclictest0-21swapper/020:45:340
3006991818,0cyclictest0-21swapper/019:45:330
3006991817,1cyclictest0-21swapper/021:00:340
3006991816,1cyclictest0-21swapper/020:45:010
3008991717,0cyclictest0-21swapper/219:35:332
3007991717,0cyclictest0-21swapper/120:45:331
3007991717,0cyclictest0-21swapper/119:25:341
3006991717,0cyclictest0-21swapper/020:10:330
3006991717,0cyclictest0-21swapper/019:55:350
300699170,0cyclictest0-21swapper/019:30:340
3011991616,0cyclictest0-21swapper/320:30:023
3011991616,0cyclictest0-21swapper/319:55:353
3008991616,0cyclictest0-21swapper/220:10:332
3007991616,0cyclictest0-21swapper/120:25:331
3007991614,1cyclictest863-21cut20:10:401
3006991616,0cyclictest0-21swapper/019:35:330
3006991614,1cyclictest0-21swapper/020:10:000
3011991514,1cyclictest0-21swapper/321:05:343
301199150,14cyclictest20148-21apt-get19:45:343
3007991515,0cyclictest0-21swapper/121:00:341
300799150,14cyclictest611-21irqbalance19:43:021
301199140,0cyclictest0-21swapper/320:45:093
301199140,0cyclictest0-21swapper/319:15:343
3008991412,1cyclictest17003-21apt-get20:45:342
300899140,14cyclictest0-21swapper/219:55:232
300899140,14cyclictest0-21swapper/219:45:152
300899140,0cyclictest0-21swapper/220:55:262
300899140,0cyclictest0-21swapper/219:21:512
300899140,0cyclictest0-21swapper/219:15:592
300799140,14cyclictest0-21swapper/119:35:211
300799140,14cyclictest0-21swapper/119:20:101
300799140,0cyclictest0-21swapper/121:05:091
300799140,0cyclictest0-21swapper/119:50:081
300699140,0cyclictest0-21swapper/019:15:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional