You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Fri Aug 21, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409207221180,3sleep00-21swapper/023:55:230
409207221180,3sleep00-21swapper/023:55:230
407465721100,2sleep30-21swapper/323:05:223
41037782980,2sleep20-21swapper/200:30:142
41061062890,3sleep23056-21PK-Backend00:35:222
139099820,69rtkit-daemon0-21swapper/319:09:463
398860927645,22sleep10-21swapper/119:05:121
399005527439,9sleep00-21swapper/019:09:410
40956712710,10sleep234-21ksoftirqd/200:05:232
398976526647,13sleep20-21swapper/219:05:572
3990221993113,5cyclictest3998832-21sed19:30:192
40122722300,2sleep10-21swapper/120:10:121
3990221992912,4cyclictest1-21systemd20:25:002
40207062270,4sleep013-21ksoftirqd/020:35:010
3990221992711,3cyclictest3996112-21sh19:25:122
139099270,18rtkit-daemon4102312-21memory00:25:173
3990221992517,6cyclictest4053854-21cron22:10:002
3990217992514,9cyclictest4052165-21systemd-run22:05:001
3990217992514,9cyclictest4052165-21systemd-run22:05:001
3990221992419,4cyclictest0-21swapper/223:13:112
399022199241,8cyclictest3990420-21apt19:10:112
399022199240,1cyclictest0-21swapper/222:36:052
3990215992414,7cyclictest4036209-21cron21:20:000
399021599240,22cyclictest4052322-21sed22:05:010
399021599240,22cyclictest4052322-21sed22:05:000
139099240,13rtkit-daemon3056-21PK-Backend23:31:303
3990221992316,1cyclictest0-21swapper/221:01:232
3990221992316,1cyclictest0-21swapper/221:01:232
399021799231,3cyclictest945-21thermald22:32:551
3990217992311,10cyclictest4050427-21unin-run21:59:591
3990215992312,9cyclictest4096306-21grep00:10:010
139099230,15rtkit-daemon0-21swapper/222:58:112
399022399221,9cyclictest4100866-21python300:20:223
3990223992217,3cyclictest4049408-21irqstats21:55:163
3990223992213,7cyclictest4008864-21df20:00:133
3990221992220,1cyclictest0-21swapper/222:34:442
3990221992220,1cyclictest0-21swapper/222:17:272
3990221992220,1cyclictest0-21swapper/220:39:462
3990221992220,1cyclictest0-21swapper/220:25:262
3990221992215,1cyclictest0-21swapper/221:57:262
399022199220,21cyclictest0-21swapper/221:23:322
399022199220,20cyclictest0-21swapper/220:07:422
3990217992220,1cyclictest0-21swapper/120:45:001
399021799220,21cyclictest0-21swapper/122:55:331
399021799220,20cyclictest3056-21PK-Backend20:05:051
399021799220,20cyclictest3056-21PK-Backend19:13:131
399021599224,16cyclictest4001045-21perf19:40:000
3990215992217,4cyclictest13-21ksoftirqd/023:07:530
3990215992214,6cyclictest883-21dbus-daemon22:20:000
3990215992214,6cyclictest4077724-21sed23:15:170
399021599220,6cyclictest4083873-21awk23:35:010
399021599220,21cyclictest0-21swapper/020:01:380
399021599220,20cyclictest945-21thermald23:02:330
399021599220,20cyclictest945-21thermald23:02:330
399021599220,20cyclictest4071466-21apt22:59:590
399022399210,19cyclictest3056-21PK-Backend23:55:553
399022399210,19cyclictest3056-21PK-Backend23:55:553
399022399210,19cyclictest3056-21PK-Backend22:56:593
399022399210,19cyclictest3056-21PK-Backend21:43:523
399022399210,19cyclictest3056-21PK-Backend00:30:283
3990221992119,1cyclictest0-21swapper/223:35:282
3990221992119,1cyclictest0-21swapper/223:33:522
3990221992119,1cyclictest0-21swapper/223:00:542
3990221992119,1cyclictest0-21swapper/223:00:532
3990221992119,1cyclictest0-21swapper/222:46:272
3990221992119,1cyclictest0-21swapper/220:17:222
3990221992119,1cyclictest0-21swapper/219:39:302
399022199210,20cyclictest0-21swapper/222:20:452
399022199210,20cyclictest0-21swapper/219:19:502
3990217992119,1cyclictest3056-21PK-Backend21:54:431
3990217992119,1cyclictest0-21swapper/123:33:111
3990217992119,1cyclictest0-21swapper/123:21:221
3990217992119,1cyclictest0-21swapper/123:07:501
3990217992119,1cyclictest0-21swapper/122:13:081
3990217992119,1cyclictest0-21swapper/122:07:201
3990217992119,1cyclictest0-21swapper/121:27:311
3990217992119,1cyclictest0-21swapper/121:20:151
3990217992119,1cyclictest0-21swapper/120:30:271
3990217992119,1cyclictest0-21swapper/100:37:061
3990217992119,1cyclictest0-21swapper/100:03:131
3990217992119,1cyclictest0-21swapper/100:03:131
3990217992118,2cyclictest3056-21PK-Backend19:26:261
3990217992113,6cyclictest4059885-21ls22:25:141
3990217992113,6cyclictest4041014-21ntp_states21:30:201
399021799210,20cyclictest0-21swapper/123:57:181
399021799210,20cyclictest0-21swapper/123:57:171
399021799210,20cyclictest0-21swapper/123:50:351
399021799210,20cyclictest0-21swapper/122:18:561
399021799210,20cyclictest0-21swapper/120:21:351
399021799210,20cyclictest0-21swapper/119:48:291
399021799210,19cyclictest3056-21PK-Backend19:33:221
3990215992119,1cyclictest0-21swapper/022:54:210
3990215992119,1cyclictest0-21swapper/022:27:510
3990215992119,1cyclictest0-21swapper/020:47:200
3990215992119,1cyclictest0-21swapper/020:37:470
3990215992119,1cyclictest0-21swapper/019:22:580
3990215992110,9cyclictest4090821-21unin-run23:55:010
399021599210,20cyclictest0-21swapper/023:37:550
399021599210,20cyclictest0-21swapper/023:13:280
399021599210,20cyclictest0-21swapper/022:47:320
399021599210,20cyclictest0-21swapper/022:38:330
399021599210,20cyclictest0-21swapper/022:12:450
399021599210,20cyclictest0-21swapper/019:44:270
399021599210,20cyclictest0-21swapper/019:29:540
139099210,14rtkit-daemon3056-21PK-Backend20:44:253
139099210,14rtkit-daemon0-21swapper/320:30:283
3990223992018,1cyclictest3056-21PK-Backend21:03:583
3990223992018,1cyclictest3056-21PK-Backend21:03:583
3990223992017,2cyclictest3056-21PK-Backend22:14:493
3990223992014,5cyclictest4002518-21sshd19:41:553
3990223992013,5cyclictest4063482-21cat22:35:153
3990223992013,5cyclictest4053861-21cron22:09:593
3990223992012,6cyclictest4084522-21awk23:35:173
3990223992012,6cyclictest3991282-21python319:10:203
399022399200,1cyclictest3056-21PK-Backend23:24:443
399022399200,1cyclictest3056-21PK-Backend21:18:183
399022399200,1cyclictest3056-21PK-Backend00:19:543
399022399200,19cyclictest3056-21PK-Backend23:52:563
399022399200,19cyclictest3056-21PK-Backend22:44:433
399022399200,19cyclictest3056-21PK-Backend22:00:573
399022399200,19cyclictest3056-21PK-Backend22:00:573
399022399200,19cyclictest3056-21PK-Backend21:26:223
399022399200,19cyclictest3056-21PK-Backend19:18:543
399022399200,19cyclictest3056-21PK-Backend00:01:023
399022399200,19cyclictest3056-21PK-Backend00:01:013
3990221992018,1cyclictest0-21swapper/223:52:522
3990221992018,1cyclictest0-21swapper/223:44:342
3990221992018,1cyclictest0-21swapper/223:22:032
3990221992018,1cyclictest0-21swapper/222:00:512
3990221992018,1cyclictest0-21swapper/222:00:512
3990221992018,1cyclictest0-21swapper/221:33:132
3990221992018,1cyclictest0-21swapper/220:46:022
399022199200,1cyclictest0-21swapper/200:29:152
399022199200,19cyclictest0-21swapper/223:28:312
399022199200,19cyclictest0-21swapper/220:43:522
3990217992018,1cyclictest0-21swapper/122:42:281
3990217992018,1cyclictest0-21swapper/121:04:341
3990217992018,1cyclictest0-21swapper/121:04:331
3990217992018,1cyclictest0-21swapper/119:56:411
3990217992017,2cyclictest0-21swapper/123:40:081
3990217992013,5cyclictest4103227-21systemctl00:30:011
399021799200,19cyclictest0-21swapper/123:37:431
399021799200,19cyclictest0-21swapper/123:02:221
399021799200,19cyclictest0-21swapper/123:02:221
399021799200,19cyclictest0-21swapper/122:35:391
399021799200,19cyclictest0-21swapper/121:40:441
399021799200,19cyclictest0-21swapper/100:11:101
3990215992018,1cyclictest0-21swapper/022:08:530
3990215992018,1cyclictest0-21swapper/021:42:020
3990215992018,1cyclictest0-21swapper/021:08:220
3990215992018,1cyclictest0-21swapper/020:27:200
3990215992018,1cyclictest0-21swapper/020:11:180
399021599200,5cyclictest4106682-21ls00:40:010
399021599200,19cyclictest3056-21PK-Backend00:21:560
399021599200,19cyclictest0-21swapper/023:23:410
399021599200,19cyclictest0-21swapper/022:21:500
399021599200,19cyclictest0-21swapper/021:39:450
399021599200,19cyclictest0-21swapper/021:33:100
399021599200,19cyclictest0-21swapper/021:28:170
399021599200,19cyclictest0-21swapper/019:32:170
399021599200,19cyclictest0-21swapper/019:19:130
399021599200,19cyclictest0-21swapper/019:11:220
399021599200,19cyclictest0-21swapper/000:10:330
139099200,14rtkit-daemon0-21swapper/320:07:013
139099200,14rtkit-daemon0-21swapper/222:14:542
139099200,13rtkit-daemon3056-21PK-Backend23:41:253
40655382190,3sleep23056-21PK-Backend22:40:172
3990223991917,1cyclictest3056-21PK-Backend23:25:333
3990223991917,1cyclictest3056-21PK-Backend22:26:393
3990223991917,1cyclictest3056-21PK-Backend21:14:393
3990223991917,1cyclictest3056-21PK-Backend20:52:353
3990223991917,1cyclictest3056-21PK-Backend20:21:473
3990223991917,1cyclictest0-21swapper/321:23:523
3990223991917,1cyclictest0-21swapper/320:46:333
3990223991916,2cyclictest3056-21PK-Backend22:21:593
3990223991916,2cyclictest3056-21PK-Backend22:18:413
3990223991913,4cyclictest2156-21gnome-shell19:45:093
3990223991912,5cyclictest3997768-21date19:30:013
3990223991911,7cyclictest4032751-21cron21:10:003
3990223991911,6cyclictest3998179-21cat19:30:123
399022399190,1cyclictest3056-21PK-Backend23:49:593
399022399190,1cyclictest3056-21PK-Backend22:54:173
399022399190,1cyclictest3056-21PK-Backend21:31:163
399022399190,1cyclictest3056-21PK-Backend20:39:453
399022399190,1cyclictest0-21swapper/320:15:593
399022399190,18cyclictest3056-21PK-Backend20:11:333
399022399190,18cyclictest3056-21PK-Backend19:55:163
3990221991917,1cyclictest0-21swapper/223:56:372
3990221991917,1cyclictest0-21swapper/223:56:362
3990221991917,1cyclictest0-21swapper/223:06:212
3990221991917,1cyclictest0-21swapper/220:13:582
3990221991917,1cyclictest0-21swapper/219:54:512
3990221991912,5cyclictest436-20systemd-journal21:20:002
3990221991912,5cyclictest4096527-21awk00:10:102
3990221991911,6cyclictest4059988-21fw_packets22:25:162
399022199190,1cyclictest0-21swapper/219:20:382
399022199190,1cyclictest0-21swapper/200:04:412
399022199190,1cyclictest0-21swapper/200:04:412
399022199190,18cyclictest0-21swapper/223:45:212
399022199190,18cyclictest0-21swapper/221:40:572
399021799199,8cyclictest4078691-21unin-run23:20:001
3990217991917,1cyclictest0-21swapper/123:47:381
3990217991917,1cyclictest0-21swapper/123:28:391
3990217991917,1cyclictest0-21swapper/121:39:351
3990217991917,1cyclictest0-21swapper/119:15:241
3990217991913,5cyclictest4031817-21sed21:05:171
3990217991912,5cyclictest436-20systemd-journal20:38:551
3990217991910,7cyclictest4026832-21ntp_states20:50:191
399021799190,1cyclictest3056-21PK-Backend22:47:551
399021799190,1cyclictest3056-21PK-Backend19:24:501
399021799190,1cyclictest0-21swapper/123:10:331
399021799190,1cyclictest0-21swapper/122:23:351
399021799190,18cyclictest3056-21PK-Backend20:19:051
3990215991917,1cyclictest0-21swapper/023:28:490
3990215991917,1cyclictest0-21swapper/022:40:430
3990215991917,1cyclictest0-21swapper/019:56:380
3990215991914,4cyclictest13-21ksoftirqd/022:35:000
399021599190,1cyclictest0-21swapper/023:46:120
399021599190,1cyclictest0-21swapper/023:42:270
399021599190,1cyclictest0-21swapper/021:54:530
399021599190,1cyclictest0-21swapper/020:07:390
399021599190,1cyclictest0-21swapper/019:47:390
399021599190,18cyclictest0-21swapper/021:01:200
399021599190,18cyclictest0-21swapper/021:01:200
139099190,4rtkit-daemon3056-21PK-Backend21:38:443
139099190,13rtkit-daemon0-21swapper/221:45:142
3990223991816,1cyclictest3056-21PK-Backend22:33:133
3990223991816,1cyclictest3056-21PK-Backend00:35:153
3990223991816,1cyclictest0-21swapper/321:50:083
399022399180,1cyclictest3056-21PK-Backend21:45:013
399022399180,16cyclictest4000314-21ntp_states19:35:173
3990221991816,1cyclictest0-21swapper/221:10:082
3990221991813,3cyclictest4003429-21cut19:45:112
3990221991811,5cyclictest4048191-21cat21:50:222
399022199180,1cyclictest0-21swapper/223:18:182
399021799182,11cyclictest4027827-21apt20:55:111
3990217991816,1cyclictest0-21swapper/122:50:061
3990217991816,1cyclictest0-21swapper/121:14:071
3990217991816,1cyclictest0-21swapper/100:17:451
3990217991812,4cyclictest436-20systemd-journal00:34:561
3990217991811,5cyclictest4009505-21sed20:00:221
3990215991816,1cyclictest0-21swapper/020:50:520
3990215991816,1cyclictest0-21swapper/020:40:300
3990215991816,1cyclictest0-21swapper/000:04:440
3990215991816,1cyclictest0-21swapper/000:04:440
3990215991813,3cyclictest4098409-21tr00:15:140
3990215991812,5cyclictest4103320-21ls00:30:000
3990215991811,5cyclictest4050404-21idleruntime-cro22:00:000
3990215991811,5cyclictest13-21ksoftirqd/020:20:110
3990223991715,1cyclictest3056-21PK-Backend20:29:173
3990223991714,2cyclictest3056-21PK-Backend00:13:323
3990223991713,3cyclictest3995382-21timerwakeupswit19:20:193
3990223991710,5cyclictest4067983-21cron22:50:013
3990221991715,1cyclictest0-21swapper/221:28:202
3990221991715,1cyclictest0-21swapper/220:31:152
3990221991715,1cyclictest0-21swapper/220:00:532
3990221991711,4cyclictest4002340-21cat19:40:212
399021799173,13cyclictest4006514-21awk19:55:001
399021799172,12cyclictest4024363-21apt20:45:121
3990217991714,2cyclictest3056-21PK-Backend19:41:321
3990217991712,3cyclictest4094942-21cut00:05:151
3990217991711,5cyclictest4036132-21seq21:19:041
399021599179,5cyclictest1095-21runrttasks21:20:010
3990215991715,1cyclictest0-21swapper/021:13:080
3990215991710,5cyclictest4014420-21ntpq20:15:160
3990223991613,2cyclictest3056-21PK-Backend23:01:063
3990223991613,2cyclictest3056-21PK-Backend23:01:063
3990223991611,3cyclictest4076942-21idleruntime-cro23:15:003
399022199169,5cyclictest4100900-21sed00:20:222
3990221991614,1cyclictest0-21swapper/219:58:162
3990221991611,3cyclictest4098806-21latency00:15:182
3990221991610,5cyclictest4042629-21cat21:35:192
3990217991612,3cyclictest4018138-21timerandwakeup20:25:211
399021599169,5cyclictest918-21rs:main0
399021599169,5cyclictest4104449-21ls00:30:220
399021599169,5cyclictest4046134-21grep21:45:180
3990215991611,3cyclictest1-21systemd21:00:000
3990223991513,1cyclictest3056-21PK-Backend19:50:313
399022399150,13cyclictest3056-21PK-Backend00:05:153
3990221991511,3cyclictest4068293-21cpu22:50:122
3990221991510,4cyclictest2156-21gnome-shell20:59:082
3990221991510,3cyclictest4031274-21acpi21:05:112
3990221991510,3cyclictest1095-21runrttasks20:50:142
3990217991511,3cyclictest4099977-21/usr/sbin/munin00:20:151
399022399149,3cyclictest4029050-21chrt20:57:103
3990223991412,1cyclictest3056-21PK-Backend23:16:543
399021799149,3cyclictest4000611-21timerwakeupswit19:35:201
399021799148,4cyclictest4046116-21grep21:45:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional