You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 12:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Apr 11, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293915821880,3sleep375-21kworker/3:1+events22:56:273
2709910995434,18cyclictest2990309-21/usr/sbin/munin23:51:280
27553472530,2chrt481ktimers/319:51:273
28838232500,2sleep3471rcuc/322:01:253
2709914994839,6cyclictest2870909-21latency_hist21:50:011
2709914994742,3cyclictest2999933-21kworker/u8:0+events_unbound00:06:181
2709916994540,4cyclictest1820292-21kworker/u8:0+flush-8:021:01:332
2709910994534,9cyclictest280-21systemd-journal23:45:000
2709910994526,16cyclictest2746340-21latency_hist19:45:010
2709916994339,3cyclictest3027223-21kworker/u8:2+flush-8:000:26:322
2709914994335,6cyclictest2801423-21gpgv20:40:011
2709910994326,15cyclictest3039986-21systemd-run00:40:000
2709910994326,15cyclictest2840645-21grep21:16:350
2709910994319,22cyclictest2752077-21diskstats19:51:200
2709910994227,13cyclictest2876470-21fschecks_count21:56:200
2709914994133,6cyclictest2881131-21/usr/sbin/munin22:01:271
2709916994035,4cyclictest1820292-21kworker/u8:0+events_unbound20:00:002
2709914994036,3cyclictest2714783-21kworker/u8:1+events_unbound19:16:351
2709910994032,6cyclictest280-21systemd-journal20:20:010
2709916993733,3cyclictest2939770-21kworker/u8:3+flush-8:023:16:362
2709916993732,4cyclictest2714783-21kworker/u8:1+flush-8:019:41:352
2709914993729,6cyclictest2791334-21/usr/sbin/munin20:31:271
2709914993728,6cyclictest280-21systemd-journal20:10:001
2709914993728,6cyclictest280-21systemd-journal20:10:001
2709910993723,12cyclictest2920656-21apt-get22:41:150
2709916993632,3cyclictest1820292-21kworker/u8:0+events_unbound19:15:022
2709910993629,5cyclictest2920298-21latency_hist22:40:010
2709910993618,16cyclictest0-21swapper/000:35:000
2709910993617,17cyclictest0-21swapper/023:21:260
270991099360,8cyclictest2935690-21/usr/sbin/munin22:56:190
2709914993528,5cyclictest2970584-21apt-get23:31:151
2709914993527,6cyclictest2879930-21ntpq21:56:281
2709914993525,8cyclictest2815369-21ntpq20:51:281
2709910993524,9cyclictest280-21systemd-journal22:20:000
270991099352,27cyclictest2714776-21kworker/0:2+events20:05:010
2709910993519,14cyclictest0-21swapper/000:16:270
2709910993518,15cyclictest0-21swapper/023:20:000
2709910993515,2cyclictest0-21swapper/023:46:240
2709910993514,2cyclictest0-21swapper/023:11:340
2709910993513,2cyclictest0-21swapper/021:11:260
27241782340,5sleep00-21swapper/019:21:260
2709916993430,3cyclictest1820292-21kworker/u8:0+events_unbound21:20:012
2709916993428,4cyclictest1820292-21kworker/u8:0+events_unbound20:01:272
2709914993428,4cyclictest2755669-21kworker/u8:2+flush-8:019:56:201
2709914993425,6cyclictest280-21systemd-journal22:36:441
2709914993424,8cyclictest2730698-21ntpq19:26:281
2709910993417,3cyclictest0-21swapper/020:36:310
2709910993416,2cyclictest0-21swapper/019:16:250
2709910993415,2cyclictest0-21swapper/023:01:200
2709910993414,3cyclictest0-21swapper/021:51:230
2709910993412,6cyclictest3010377-21diskstats00:11:210
2709914993327,4cyclictest2935436-21apt-get22:56:141
270991099332,8cyclictest583-21snmpd23:36:160
270991099332,30cyclictest0-21swapper/020:56:330
2709910993317,3cyclictest2915406-21systemd-run22:35:010
2709910993316,3cyclictest0-21swapper/023:26:220
2709910993316,2cyclictest0-21swapper/022:50:010
2709910993316,2cyclictest0-21swapper/021:26:270
2709910993315,3cyclictest2891002-21acpi22:11:140
2709910993315,3cyclictest2871018-21latency_hist21:50:010
2709910993315,3cyclictest0-21swapper/019:56:240
2709910993314,2cyclictest0-21swapper/021:36:270
2709910993313,5cyclictest2736165-21grep19:31:360
2709910993313,3cyclictest2811610-21acpi20:51:150
2709910993312,7cyclictest2900945-21apt-get22:21:180
2709910993312,7cyclictest2900945-21apt-get22:21:180
270991099331,13cyclictest2970589-21runrttasks23:31:160
27094502334,9sleep20-21swapper/219:06:402
270991099322,29cyclictest0-21swapper/023:56:340
2709910993216,2cyclictest0-21swapper/021:21:240
2709910993214,2cyclictest0-21swapper/020:21:260
2709910993213,2cyclictest0-21swapper/000:26:160
2709910993210,7cyclictest2824801-21cut21:01:260
2709910993210,6cyclictest2855348-21sed21:31:360
2709916993125,4cyclictest2790694-21unixbench_singl20:26:352
2709914993123,5cyclictest2890681-21latency_hist22:10:011
2709914993121,7cyclictest280-21systemd-journal20:25:011
270991099312,27cyclictest2975200-21kworker/0:2+events00:21:310
270991099312,12cyclictest2826511-21taskset21:06:170
2709910993117,12cyclictest2710133-21apt-get19:11:160
2709910993115,14cyclictest2741076-21unixbench_singl19:36:330
2709910993114,3cyclictest2935086-21cron22:55:000
270991099311,10cyclictest589-21runrttasks20:06:170
270991099311,10cyclictest589-21runrttasks20:06:170
27901592300,3sleep1281rcuc/120:26:281
2709916993026,3cyclictest2960029-21kworker/u8:1+flush-8:023:51:362
2709916993025,4cyclictest2890923-21kworker/u8:1+flush-8:022:16:282
2709916993025,3cyclictest2984664-21unixbench_multi23:41:352
2709914993025,3cyclictest3017211-21kthreadcore00:16:261
2709914993024,4cyclictest3025175-21apt-get00:26:141
2709914993023,5cyclictest2755669-21kworker/u8:2+flush-8:020:11:201
2709914993023,4cyclictest3024835-21latency_hist00:25:011
2709916992925,3cyclictest2881215-21aten2_r5power_e22:01:172
2709914992924,3cyclictest2856708-21cut21:36:221
2709914992918,8cyclictest2805564-21ntpq20:41:301
2709910992914,3cyclictest0-21swapper/019:30:000
2709916992825,2cyclictest2961259-21irqcore23:21:222
2709916992824,2cyclictest2999588-21unixbench_singl23:56:352
2709914992822,4cyclictest2755669-21kworker/u8:2+flush-8:020:16:211
2709910992824,3cyclictest2751472-21gpgv19:50:000
2709910992822,4cyclictest2890923-21kworker/u8:1+flush-8:022:25:350
2709910992817,1cyclictest0-21swapper/020:30:230
2709916992723,2cyclictest2821219-21munin-plugin-st21:00:002
2709914992723,2cyclictest2827225-21irqrtprio21:06:231
2709914992721,4cyclictest3004498-21unixbench_multi00:01:351
2709914992721,4cyclictest2979770-21unixbench_multi23:36:361
2709914992721,4cyclictest2841337-21apt-get21:21:151
2709914992721,4cyclictest2836062-21cron21:15:001
2709914992721,4cyclictest2750932-21unixbench_singl19:46:361
2709914992718,7cyclictest2735625-21ntpq19:31:291
2709910992723,3cyclictest2950455-21systemd-run23:10:010
2709910992711,7cyclictest280-21systemd-journal20:48:190
2709916992623,2cyclictest2985690-21fschecks_time23:46:192
2709916992622,3cyclictest2755669-21kworker/u8:2+flush-8:019:51:362
2709914992622,3cyclictest2840601-21unixbench_multi21:16:351
2709914992618,6cyclictest2985376-21apt-get23:46:141
2709914992618,6cyclictest2954508-21ntpq23:11:271
2709914992618,6cyclictest2900245-21unixbench_singl22:16:341
2709914992618,5cyclictest2960309-21latency_hist23:20:001
270878622613,6sleep02708858-21ntpq19:06:260
2709916992521,3cyclictest3009418-21unixbench_multi00:06:372
2709914992521,2cyclictest0-21swapper/121:01:171
2709914992521,2cyclictest0-21swapper/120:01:171
2709914992520,4cyclictest2791036-21kworker/u8:3+flush-8:021:31:301
2709914992520,2cyclictest0-21swapper/119:15:011
2709914992519,4cyclictest2925244-21idleruntime-cro22:45:001
270991499251,11cyclictest28957202latency_hist22:15:001
2709910992521,2cyclictest3000477-21tr00:01:180
2709916992420,2cyclictest2710246-21aten2_r5power_v19:11:182
2709916992419,4cyclictest2806069-21kworker/u8:2+events_unbound20:41:492
2709916992416,6cyclictest2855876-21cp21:35:002
2709914992421,2cyclictest2960891-21cpuspeed_turbos23:21:181
2709914992420,3cyclictest401-21dbus-daemon22:35:011
2709914992420,2cyclictest0-21swapper/121:51:211
2709914992420,2cyclictest0-21swapper/119:51:171
2709914992418,3cyclictest0-21swapper/122:51:351
2709914992411,9cyclictest280-21systemd-journal00:32:321
270991099244,16cyclictest0-21swapper/022:01:160
2709910992411,2cyclictest0-21swapper/022:06:280
2709910992411,10cyclictest2786675-21diskstats20:26:200
27051712244,12sleep10-21swapper/119:06:141
2709916992319,2cyclictest2916016-21fschecks_count22:36:202
2709916992318,4cyclictest2910078-21unixbench_multi22:26:362
2709914992319,2cyclictest0-21swapper/121:41:251
2709914992318,4cyclictest2731539-21kworker/u8:3+flush-8:019:35:211
2709914992318,3cyclictest2999579-21unixbench_singl23:56:351
2709914992316,5cyclictest2866177-21kworker/u8:0+flush-8:023:41:301
270991699225,2cyclictest28426701kthreadcore21:21:242
2709916992218,2cyclictest2945904-21aten2_r5power_p23:06:182
2709916992218,2cyclictest2860621-21unixbench_multi21:36:392
2709916992217,3cyclictest0-21swapper/220:40:012
2709916992217,3cyclictest0-21swapper/200:20:002
2709916992214,6cyclictest280-21systemd-journal22:52:442
2709914992218,2cyclictest0-21swapper/119:41:341
2709914992217,4cyclictest2850490-21unixbench_multi21:26:361
2709914992216,4cyclictest2806069-21kworker/u8:2+events_unbound23:06:361
2709914992215,5cyclictest3034735-21apt-get00:35:031
2709914992215,5cyclictest0-21swapper/122:46:181
2709914992213,7cyclictest3013879-21ntpq00:11:301
2709914992212,6cyclictest0-21swapper/120:46:171
2709914992211,3cyclictest0-21swapper/123:03:571
2709916992117,3cyclictest2771281-21kworker/u8:1+flush-8:020:10:202
2709916992117,2cyclictest0-21swapper/223:05:012
2709916992117,2cyclictest0-21swapper/222:50:002
2709914992116,3cyclictest2821250-21systemd-run21:00:011
2709914992112,7cyclictest2905516-21latency_hist22:25:001
2709914992112,7cyclictest2905516-21latency_hist22:25:001
2709914992110,2cyclictest0-21swapper/123:25:121
2709910992117,3cyclictest8550irq/124-ahci[0000:00:12.0]20:10:150
270991699202,17cyclictest0-21swapper/200:21:332
2709916992016,3cyclictest2806069-21kworker/u8:2+events_unbound22:05:042
2709916992016,2cyclictest3010185-21aten2_r5power_e00:11:192
2709916992016,2cyclictest2870594-21unixbench_singl21:46:352
2709916992015,3cyclictest2734368-21kthreadcore19:31:252
2709916992013,5cyclictest2796360-21base6420:35:012
2709914992015,3cyclictest2995079-21latency_hist23:55:011
2709914992014,4cyclictest0-21swapper/119:21:191
2709914992013,5cyclictest0-21swapper/122:26:191
2709910992012,6cyclictest2805475-21ntpq20:41:280
270991699198,3cyclictest39-21ksoftirqd/223:00:012
270991699191,6cyclictest2750453-21ntpq19:46:302
2709916991915,3cyclictest0-21swapper/221:30:002
2709916991915,2cyclictest0-21swapper/221:56:272
2709916991914,3cyclictest0-21swapper/223:31:352
270991099199,8cyclictest0-21swapper/000:06:210
27096602194,8sleep30-21swapper/319:09:223
29491172187,7sleep30-21swapper/323:06:273
270991699188,2cyclictest29508281aten2_r5power_e23:11:172
2709916991814,2cyclictest2861669-21fschecks_time21:41:192
2709916991813,3cyclictest0-21swapper/200:35:012
2709916991811,5cyclictest2785491-21sensors_volt20:21:342
2709910991815,2cyclictest0-21swapper/021:41:340
270991699178,7cyclictest0-21swapper/223:26:182
2709916991714,2cyclictest371rcuc/219:36:242
2709916991713,2cyclictest2730354-21kthreadcore19:26:252
2709916991712,3cyclictest2816214-21cron20:55:002
2709916991710,5cyclictest2892611-21tr22:11:232
270991699170,5cyclictest2723212-21kthreadcore19:21:252
270991699170,4cyclictest2904757-21ntp_states22:21:332
270991699170,4cyclictest2904757-21ntp_states22:21:332
27102052160,6sleep3451irq_work/319:11:173
270991699162,13cyclictest0-21swapper/222:30:342
270991699162,13cyclictest0-21swapper/221:12:312
270991699162,13cyclictest0-21swapper/221:05:122
270991699162,13cyclictest0-21swapper/200:39:272
2709916991613,2cyclictest0-21swapper/220:15:482
2709916991613,2cyclictest0-21swapper/220:08:082
2709916991613,2cyclictest0-21swapper/220:08:082
2709916991613,2cyclictest0-21swapper/200:00:422
2709916991612,2cyclictest2810923-21unixbench_multi20:46:362
270991699161,11cyclictest2920656-21apt-get22:41:162
2709916991610,4cyclictest0-21swapper/223:36:242
27626362156,5sleep30-21swapper/320:01:233
28865772142,8sleep30-21swapper/322:06:243
28400322142,8sleep30-21swapper/321:16:273
27207552143,7sleep30-21swapper/319:16:293
270991699146,6cyclictest2871856-21sed21:51:232
30002612132,7sleep30-21swapper/300:01:173
29900052132,6sleep30-21swapper/323:50:013
29615872133,7sleep30-21swapper/323:21:243
29411142132,7sleep30-21swapper/323:01:213
29302072132,6sleep30-21swapper/322:50:023
29108092132,7sleep30-21swapper/322:31:203
29011492132,7sleep30-21swapper/322:21:203
29011492132,7sleep30-21swapper/322:21:193
28803762132,7sleep30-21swapper/321:56:363
28501692133,6sleep30-21swapper/321:26:353
28054562132,7sleep30-21swapper/320:41:283
27720652132,7sleep30-21swapper/320:11:223
27315262132,6sleep30-21swapper/319:30:013
30147312122,5sleep30-21swapper/300:15:013
30139112122,6sleep30-21swapper/300:11:323
29868492120,4sleep3481ktimers/323:46:233
29797322122,6sleep30-21swapper/323:36:373
29750612122,6sleep30-21swapper/323:33:443
29680432122,6sleep30-21swapper/323:26:263
29553942122,6sleep30-21swapper/323:15:023
29273282122,6sleep30-21swapper/322:46:253
29195632122,6sleep30-21swapper/322:36:333
28968452124,5sleep30-21swapper/322:16:233
28712932123,5sleep30-21swapper/321:51:193
28700582121,7sleep30-21swapper/321:46:293
28656112122,6sleep30-21swapper/321:41:363
28558852122,5sleep30-21swapper/321:35:013
28451902122,5sleep30-21swapper/321:21:333
28314492122,6sleep30-21swapper/321:11:183
28214072122,5sleep30-21swapper/321:00:013
28123452122,6sleep30-21swapper/320:51:233
27961112121,6sleep30-21swapper/320:35:023
27611132122,6sleep30-21swapper/319:56:383
27470722122,6sleep30-21swapper/319:46:223
27312232122,6sleep30-21swapper/319:26:363
27217702122,5sleep30-21swapper/319:20:023
30381592112,5sleep30-21swapper/300:36:243
30300232112,5sleep30-21swapper/300:30:023
30251802112,5sleep30-21swapper/300:26:173
30201302112,5sleep30-21swapper/300:20:113
30050732112,5sleep30-21swapper/300:05:023
29955182112,5sleep30-21swapper/323:56:193
29849272112,5sleep30-21swapper/323:43:513
29511522112,5sleep30-21swapper/323:11:213
29212262112,5sleep30-21swapper/322:41:233
29057542112,6sleep30-21swapper/322:25:183
28906932112,5sleep30-21swapper/322:10:013
28548362111,6sleep30-21swapper/321:31:283
28264022112,6sleep30-21swapper/321:05:163
28165722112,5sleep30-21swapper/320:56:173
28070552112,6sleep30-21swapper/320:46:223
27950962112,5sleep30-21swapper/320:31:293
27865872112,5sleep30-21swapper/320:26:193
27818722112,5sleep30-21swapper/320:21:223
27811122112,5sleep30-21swapper/320:20:013
27712202112,5sleep30-21swapper/320:09:383
27712202112,5sleep30-21swapper/320:09:383
27422872112,5sleep30-21swapper/319:41:253
27406372112,5sleep30-21swapper/319:36:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional