You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-06 - 03:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jun 06, 2026 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2306299350,34cyclictest0-21swapper/020:38:580
23072992624,1cyclictest0-21swapper/222:07:182
2306699260,25cyclictest32460-21ssh21:55:011
23062992624,1cyclictest19439-21apt-get21:13:590
2307699250,0cyclictest0-21swapper/323:35:273
2307299252,22cyclictest14240-21cron00:40:012
23072992520,1cyclictest0-21swapper/221:56:132
2307299250,24cyclictest24250-21grep23:49:042
23076992422,1cyclictest0-21swapper/322:55:243
2307699240,23cyclictest10834-21sh00:06:453
2307699240,23cyclictest0-21swapper/323:24:223
2307699240,0cyclictest16694-21diskmemload23:52:223
2307699240,0cyclictest0-21swapper/322:39:103
23072992420,4cyclictest0-21swapper/221:46:122
23072992419,4cyclictest0-21swapper/223:27:112
2307299240,23cyclictest16694-21diskmemload23:09:542
2307299240,23cyclictest0-21swapper/222:25:022
2307299240,23cyclictest0-21swapper/221:39:112
2307299240,1cyclictest9768-21cron23:05:012
2307299240,0cyclictest0-21swapper/223:41:422
23066992424,0cyclictest0-21swapper/100:12:471
23066992423,1cyclictest0-21swapper/100:03:411
23066992421,2cyclictest0-21swapper/121:33:031
2306699240,24cyclictest16694-21diskmemload22:57:181
2306699240,24cyclictest0-21swapper/123:28:431
2306699240,1cyclictest14880-21apt-get21:08:581
2306699240,0cyclictest0-21swapper/123:10:351
23062992422,1cyclictest0-21swapper/023:09:030
23062992421,2cyclictest16947-21ssh22:11:190
2306299240,23cyclictest26985-21turbostat.cron21:50:000
2306299240,23cyclictest16694-21diskmemload23:52:090
2306299240,23cyclictest16694-21diskmemload22:44:250
2306299240,0cyclictest0-21swapper/021:25:380
23076992323,0cyclictest0-21swapper/321:50:023
23076992323,0cyclictest0-21swapper/300:12:023
23076992322,1cyclictest2071-21ssh21:58:003
23076992321,1cyclictest12319-21ssh21:37:013
23076992321,1cyclictest0-21swapper/319:30:003
23076992320,2cyclictest7067-21sh21:32:143
23076992320,2cyclictest31487-21diskmemload22:24:373
2307699231,21cyclictest20784-21ssh00:15:493
2307699231,1cyclictest34-21ksoftirqd/321:21:373
2307699230,23cyclictest2125-21ssh21:27:413
2307699230,23cyclictest16694-21diskmemload21:11:333
2307699230,23cyclictest16694-21diskmemload00:39:273
2307699230,23cyclictest0-21swapper/323:46:333
2307699230,23cyclictest0-21swapper/322:51:173
2307699230,22cyclictest23439-21ssh22:48:323
2307699230,22cyclictest23323-21sh21:16:443
2307699230,22cyclictest21957-21sh21:45:013
2307699230,22cyclictest16694-21diskmemload22:34:043
2307699230,22cyclictest0-21swapper/323:06:573
2307699230,22cyclictest0-21swapper/322:07:163
2307699230,21cyclictest151rcu_preempt00:20:303
2307699230,1cyclictest0-21swapper/323:25:353
2307699230,0cyclictest16694-21diskmemload00:29:323
2307699230,0cyclictest0-21swapper/323:34:293
2307699230,0cyclictest0-21swapper/322:18:463
23072992323,0cyclictest16694-21diskmemload23:20:272
23072992323,0cyclictest16694-21diskmemload22:15:292
23072992323,0cyclictest0-21swapper/221:50:482
23072992323,0cyclictest0-21swapper/221:28:272
23072992323,0cyclictest0-21swapper/200:23:292
23072992320,2cyclictest9121-21ssh00:04:352
23072992320,2cyclictest7631-21ssh21:33:012
23072992320,2cyclictest21549-21sh22:45:362
23072992320,0cyclictest0-21swapper/223:15:282
2307299230,2cyclictest7078-21ssh22:32:472
2307299230,2cyclictest30881-21ssh23:54:432
2307299230,22cyclictest27980-21ssh22:22:062
2307299230,22cyclictest27119-21diskmemload21:19:522
2307299230,22cyclictest15448-21ssh23:10:202
2307299230,22cyclictest0-21swapper/200:10:192
2307299230,0cyclictest16694-21diskmemload00:28:492
2307299230,0cyclictest0-21swapper/221:41:112
2307299230,0cyclictest0-21swapper/221:11:232
2307299230,0cyclictest0-21swapper/200:30:422
23066992323,0cyclictest0-21swapper/123:41:001
23066992323,0cyclictest0-21swapper/122:47:211
23066992323,0cyclictest0-21swapper/121:22:321
23066992323,0cyclictest0-21swapper/121:13:311
23066992323,0cyclictest0-21swapper/100:38:231
23066992323,0cyclictest0-21swapper/100:32:351
23066992321,1cyclictest14921-21sh23:09:481
23066992321,1cyclictest12944-21ssh21:38:031
23066992321,1cyclictest0-21swapper/121:17:311
2306699230,2cyclictest5213-21sendmail22:00:001
2306699230,2cyclictest3965-21idleruntime-cro00:00:011
2306699230,23cyclictest0-21swapper/123:20:431
2306699230,23cyclictest0-21swapper/123:03:031
2306699230,23cyclictest0-21swapper/121:27:281
2306699230,22cyclictest22230-21ssh21:45:231
2306699230,22cyclictest20887-21ssh22:44:551
2306699230,22cyclictest17080-21perf20:05:001
2306699230,22cyclictest16900-21ssh21:40:211
2306699230,22cyclictest16694-21diskmemload22:14:121
2306699230,22cyclictest11617-21sh22:06:191
2306699230,22cyclictest0-21swapper/122:52:161
2306699230,22cyclictest0-21swapper/122:01:141
2306699230,22cyclictest0-21swapper/100:29:071
2306699230,1cyclictest0-21swapper/123:31:491
2306699230,0cyclictest0-21swapper/123:50:311
2306699230,0cyclictest0-21swapper/123:47:081
23062992323,0cyclictest0-21swapper/023:41:460
23062992323,0cyclictest0-21swapper/022:55:330
23062992323,0cyclictest0-21swapper/022:18:440
23062992321,2cyclictest0-21swapper/022:23:350
23062992321,1cyclictest1803-21ssh21:57:380
23062992321,1cyclictest0-21swapper/022:46:460
23062992321,1cyclictest0-21swapper/022:28:550
23062992321,1cyclictest0-21swapper/019:33:580
23062992321,1cyclictest0-21swapper/000:07:060
23062992320,2cyclictest30273-21ls19:25:000
23062992320,2cyclictest27250-21sh21:50:040
23062992320,2cyclictest25424-21awk00:20:000
23062992320,2cyclictest12718-21sh21:37:450
23062992320,2cyclictest10706-21ssh21:34:590
2306299230,23cyclictest16694-21diskmemload00:36:500
2306299230,23cyclictest0-21swapper/023:49:280
2306299230,23cyclictest0-21swapper/000:20:490
2306299230,22cyclictest22393-21ssh21:15:170
2306299230,22cyclictest14649-21awk20:00:000
2306299230,1cyclictest0-21swapper/021:40:010
2306299230,1cyclictest0-21swapper/000:34:080
2306299230,0cyclictest0-21swapper/023:26:580
23076992222,0cyclictest0-21swapper/322:01:023
23076992220,1cyclictest2652-21cron19:35:003
23076992220,1cyclictest0-21swapper/320:10:003
2307699220,22cyclictest0-21swapper/323:58:483
2307699220,21cyclictest25404-21cron19:15:003
2307699220,21cyclictest15986-21apt-get21:40:023
2307699220,21cyclictest0-21swapper/323:40:323
2307699220,21cyclictest0-21swapper/323:15:373
2307699220,21cyclictest0-21swapper/323:00:183
2307699220,21cyclictest0-21swapper/300:02:453
2307699220,1cyclictest5104-21ssh00:32:013
2307699220,1cyclictest16467-21ssh22:40:573
2307699220,0cyclictest0-21swapper/322:11:053
23072992222,0cyclictest16694-21diskmemload00:07:162
23072992221,0cyclictest30840-21apt-get19:28:582
23072992220,0cyclictest0-21swapper/222:54:182
23072992219,2cyclictest27806-21latency_hist19:20:002
23072992219,0cyclictest0-21swapper/222:10:532
2307299220,22cyclictest10811-21ssh23:37:062
2307299220,22cyclictest0-21swapper/222:01:372
2307299220,21cyclictest29698-21apt-get20:33:592
2307299220,21cyclictest24849-21apt-get20:23:582
2307299220,21cyclictest17076-21turbostat.cron20:05:002
2307299220,21cyclictest16694-21diskmemload23:55:472
2307299220,21cyclictest16694-21diskmemload22:41:302
2307299220,21cyclictest16694-21diskmemload00:15:342
2307299220,21cyclictest0-21swapper/222:55:502
2307299220,21cyclictest0-21swapper/221:20:222
2307299220,0cyclictest0-21swapper/222:36:252
23066992222,0cyclictest0-21swapper/122:23:591
23066992222,0cyclictest0-21swapper/100:07:501
23066992221,1cyclictest0-21swapper/100:15:541
23066992220,1cyclictest32450-21sh22:25:121
23066992220,1cyclictest0-21swapper/123:35:051
23066992220,1cyclictest0-21swapper/122:35:071
2306699220,22cyclictest0-21swapper/123:15:251
2306699220,21cyclictest0-21swapper/120:58:571
2306699220,21cyclictest0-21swapper/120:18:581
2306699220,21cyclictest0-21swapper/100:21:521
2306699220,1cyclictest13938-21munin-run21:05:001
2306699220,1cyclictest0-21swapper/122:30:031
2306699220,1cyclictest0-21swapper/122:16:081
23062992222,0cyclictest16694-21diskmemload22:01:590
23062992222,0cyclictest0-21swapper/023:20:280
23062992222,0cyclictest0-21swapper/020:23:580
23062992221,1cyclictest62550irq/127-eno100:01:170
23062992220,1cyclictest0-21swapper/023:30:180
23062992220,1cyclictest0-21swapper/022:36:020
23062992220,1cyclictest0-21swapper/021:20:530
23062992220,1cyclictest0-21swapper/000:25:180
2306299220,22cyclictest0-21swapper/022:31:520
2306299220,21cyclictest9675-21apt-get20:58:580
2306299220,21cyclictest31536-21sh23:55:230
2306299220,21cyclictest15666-21sh23:10:370
2306299220,21cyclictest0-21swapper/023:15:120
2306299220,21cyclictest0-21swapper/020:08:580
2306299220,21cyclictest0-21swapper/019:48:580
2306299220,1cyclictest27202-21ssh22:51:070
2306299220,1cyclictest0-21swapper/023:36:470
23076992120,0cyclictest15238-21apt-get20:03:583
23076992119,1cyclictest0-21swapper/323:12:163
2307699210,21cyclictest0-21swapper/319:58:593
2307699210,20cyclictest3930-21apt-get20:45:023
23072992120,0cyclictest12092-21apt-get21:03:582
2307299210,20cyclictest12825-21apt-get19:59:002
2307299210,20cyclictest0-21swapper/219:48:592
2307299210,1cyclictest4144-21ssh23:30:032
2307299210,0cyclictest812-21apt-get19:33:582
2307299210,0cyclictest0-21swapper/220:43:582
23066992120,1cyclictest0-21swapper/120:38:581
23066992120,1cyclictest0-21swapper/120:28:581
23066992120,1cyclictest0-21swapper/120:28:581
23066992119,1cyclictest2096-21apt-get20:43:581
23066992118,2cyclictest313-21systemd-journal19:50:011
2306699210,21cyclictest0-21swapper/120:48:581
2306699210,21cyclictest0-21swapper/119:13:581
23062992119,2cyclictest0-21swapper/023:00:020
23062992119,1cyclictest0-21swapper/019:45:010
2306299210,21cyclictest16694-21diskmemload00:11:160
23076992020,0cyclictest0-21swapper/320:33:593
23076992020,0cyclictest0-21swapper/319:48:583
23076992018,1cyclictest25973-21apt-get19:18:583
23076992016,3cyclictest622-21gdbus20:30:013
23076992016,3cyclictest622-21gdbus20:30:013
2307699200,19cyclictest0-21swapper/321:05:023
23072992020,0cyclictest27243-21apt-get20:28:582
23072992020,0cyclictest27243-21apt-get20:28:582
23072992020,0cyclictest0-21swapper/220:13:582
23072992018,1cyclictest16730-21munin-run21:10:002
23066992020,0cyclictest0-21swapper/119:53:581
23066992020,0cyclictest0-21swapper/119:38:571
23066992018,1cyclictest14628-21cron20:00:001
23066992018,1cyclictest0-21swapper/119:25:001
2306699200,0cyclictest0-21swapper/119:33:571
23062992020,0cyclictest0-21swapper/020:45:020
23062992020,0cyclictest0-21swapper/020:13:580
2306299200,19cyclictest0-21swapper/021:05:020
2306299200,0cyclictest0-21swapper/019:53:580
23076991919,0cyclictest0-21swapper/320:53:593
23072991919,0cyclictest0-21swapper/219:38:562
2307299190,18cyclictest0-21swapper/220:08:592
2306299190,9cyclictest0-21swapper/020:53:590
23076991818,0cyclictest0-21swapper/321:03:583
2307299180,0cyclictest22424-21apt-get20:18:582
23062991818,0cyclictest0-21swapper/021:03:580
23062991816,1cyclictest62550irq/127-eno119:18:580
23076991717,0cyclictest0-21swapper/320:38:583
23076991717,0cyclictest0-21swapper/319:23:593
23072991716,1cyclictest0-21swapper/220:58:572
2307299170,2cyclictest6764-21latency_hist20:50:002
23066991717,0cyclictest20027-21apt-get20:13:581
23066991717,0cyclictest0-21swapper/120:33:591
23066991715,1cyclictest27827-21dump-pmu-power19:20:001
23062991717,0cyclictest0-21swapper/020:18:580
23076991616,0cyclictest0-21swapper/320:58:583
23076991616,0cyclictest0-21swapper/320:23:583
23076991616,0cyclictest0-21swapper/319:53:583
23072991616,0cyclictest0-21swapper/219:13:582
2307299150,1cyclictest7487-21munin-run19:45:012
23066991515,0cyclictest0-21swapper/120:08:591
23066991514,1cyclictest26692-21perf20:25:011
2306299150,1cyclictest0-21swapper/020:03:440
2307699140,14cyclictest0-21swapper/320:40:163
2307699140,14cyclictest0-21swapper/320:15:043
2307699140,14cyclictest0-21swapper/320:10:413
2307699140,14cyclictest0-21swapper/319:41:123
2307699140,0cyclictest0-21swapper/319:35:203
2307299140,14cyclictest0-21swapper/220:50:132
2307299140,14cyclictest0-21swapper/220:35:132
2307299140,14cyclictest0-21swapper/219:52:272
23066991414,0cyclictest0-21swapper/119:40:051
2306699140,14cyclictest0-21swapper/120:51:101
2306699140,0cyclictest0-21swapper/119:25:171
23062991414,0cyclictest0-21swapper/020:30:370
23062991414,0cyclictest0-21swapper/020:25:010
23062991414,0cyclictest0-21swapper/020:25:010
23062991414,0cyclictest0-21swapper/019:35:260
2306299140,0cyclictest0-21swapper/020:41:010
2306299140,0cyclictest0-21swapper/019:25:520
2306299140,0cyclictest0-21swapper/019:11:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional