You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-06 - 03:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sun Sep 06, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45004121180,11sleep30-21swapper/319:05:143
45093527838,13sleep10-21swapper/119:05:281
139099750,60rtkit-daemon0-21swapper/219:08:292
45077126140,14sleep00-21swapper/019:05:280
4584232540,3sleep013-21ksoftirqd/019:25:210
5477162520,5sleep13056-21PK-Backend23:40:171
5443162500,3sleep13056-21PK-Backend23:30:191
4647372400,3sleep00-21swapper/019:45:010
4756212390,3sleep00-21swapper/020:15:140
5387772370,2sleep20-21swapper/223:15:162
4870222320,4sleep00-21swapper/020:45:210
45143799278,10cyclictest13-21ksoftirqd/020:30:000
139099260,18rtkit-daemon0-21swapper/321:05:223
5527272250,3sleep10-21swapper/123:55:121
139099250,17rtkit-daemon0-21swapper/223:35:132
139099250,16rtkit-daemon3056-21PK-Backend21:53:013
451439992410,12cyclictest504947-21unin-run21:40:011
139099240,16rtkit-daemon3056-21PK-Backend21:57:593
139099240,12rtkit-daemon493396-21cat21:05:162
451443992315,6cyclictest481656-21ntp_states20:30:202
451443992314,6cyclictest536367-21munin-run23:10:002
451443992310,3cyclictest559180-21dump-pmu-power00:15:012
451439992320,2cyclictest3056-21PK-Backend21:02:461
4985412220,4chrt3056-21PK-Backend21:20:141
451445992220,1cyclictest3056-21PK-Backend22:52:253
451445992220,1cyclictest0-21swapper/322:23:263
451445992220,1cyclictest0-21swapper/300:32:363
451445992220,1cyclictest0-21swapper/300:00:063
45144599220,20cyclictest3056-21PK-Backend22:58:333
45144599220,20cyclictest3056-21PK-Backend00:16:413
45144399227,12cyclictest524268-21unin-run22:35:012
451443992220,1cyclictest0-21swapper/222:29:182
451443992220,1cyclictest0-21swapper/220:11:492
451443992220,1cyclictest0-21swapper/219:22:482
45144399220,21cyclictest0-21swapper/200:34:582
451439992220,1cyclictest3056-21PK-Backend00:27:121
451439992219,2cyclictest3056-21PK-Backend22:27:551
45143999220,20cyclictest3056-21PK-Backend20:18:381
45143799220,20cyclictest3056-21PK-Backend00:20:510
139099220,14rtkit-daemon0-21swapper/219:33:302
45144599212,17cyclictest556920-21/usr/sbin/munin00:05:233
451445992119,1cyclictest3056-21PK-Backend22:18:053
451445992119,1cyclictest3056-21PK-Backend20:04:283
451445992119,1cyclictest0-21swapper/323:50:043
451445992119,1cyclictest0-21swapper/321:12:003
451445992119,1cyclictest0-21swapper/320:27:473
451445992119,1cyclictest0-21swapper/319:57:053
451445992119,1cyclictest0-21swapper/319:57:053
451445992119,1cyclictest0-21swapper/319:25:213
451445992119,1cyclictest0-21swapper/319:21:223
451445992119,1cyclictest0-21swapper/300:23:453
451445992118,2cyclictest3056-21PK-Backend22:11:563
45144599210,20cyclictest0-21swapper/322:34:203
45144599210,20cyclictest0-21swapper/321:16:413
45144599210,19cyclictest3056-21PK-Backend20:40:103
45144599210,19cyclictest3056-21PK-Backend19:35:563
45144599210,19cyclictest3056-21PK-Backend19:30:083
45144599210,19cyclictest3056-21PK-Backend19:10:273
451443992119,1cyclictest0-21swapper/223:34:132
451443992119,1cyclictest0-21swapper/223:22:592
451443992119,1cyclictest0-21swapper/223:11:572
451443992119,1cyclictest0-21swapper/222:57:102
451443992119,1cyclictest0-21swapper/222:11:262
451443992119,1cyclictest0-21swapper/222:09:182
451443992119,1cyclictest0-21swapper/221:46:592
451443992119,1cyclictest0-21swapper/221:14:422
451443992119,1cyclictest0-21swapper/220:06:082
451443992119,1cyclictest0-21swapper/200:39:242
451443992119,1cyclictest0-21swapper/200:21:392
451443992117,3cyclictest534616-21cron23:04:592
451443992113,5cyclictest550216-21cron23:50:002
451443992113,5cyclictest550216-21cron23:50:002
45144399210,20cyclictest0-21swapper/223:52:182
45144399210,20cyclictest0-21swapper/220:37:382
45144399210,20cyclictest0-21swapper/219:45:402
45144399210,20cyclictest0-21swapper/200:06:462
45144399210,20cyclictest0-21swapper/200:03:202
45144399210,1cyclictest0-21swapper/222:19:582
451439992119,1cyclictest3056-21PK-Backend22:30:061
451439992119,1cyclictest3056-21PK-Backend19:55:131
451439992119,1cyclictest3056-21PK-Backend19:55:121
451439992119,1cyclictest0-21swapper/122:59:121
451439992119,1cyclictest0-21swapper/121:47:001
451439992119,1cyclictest0-21swapper/119:37:141
451439992119,1cyclictest0-21swapper/119:10:111
451439992118,2cyclictest3056-21PK-Backend21:26:031
45143999210,20cyclictest3056-21PK-Backend21:19:151
45143999210,20cyclictest0-21swapper/120:10:071
45143999210,19cyclictest3056-21PK-Backend23:50:571
45143999210,19cyclictest0-21swapper/122:47:561
451437992119,1cyclictest0-21swapper/023:35:210
451437992119,1cyclictest0-21swapper/023:11:290
451437992119,1cyclictest0-21swapper/023:08:520
451437992119,1cyclictest0-21swapper/022:43:030
451437992119,1cyclictest0-21swapper/020:23:170
451437992113,6cyclictest453635-21if_enp2s019:15:010
45143799210,2cyclictest474433-21ntpq20:10:190
45143799210,20cyclictest0-21swapper/023:43:460
45143799210,20cyclictest0-21swapper/000:09:340
45143799210,19cyclictest3056-21PK-Backend21:25:300
139099210,15rtkit-daemon0-21swapper/323:46:123
139099210,15rtkit-daemon0-21swapper/323:46:123
139099210,14rtkit-daemon0-21swapper/321:33:283
139099210,14rtkit-daemon0-21swapper/319:41:333
139099210,13rtkit-daemon3056-21PK-Backend23:05:033
451445992018,1cyclictest3056-21PK-Backend20:46:533
451445992018,1cyclictest3056-21PK-Backend00:35:133
451445992018,1cyclictest0-21swapper/323:30:243
451445992018,1cyclictest0-21swapper/323:27:473
451445992018,1cyclictest0-21swapper/322:37:313
451445992018,1cyclictest0-21swapper/322:25:013
451445992018,1cyclictest0-21swapper/321:23:033
451445992014,4cyclictest2156-21gnome-shell19:50:083
451445992013,5cyclictest475252-21date20:15:003
451445992012,5cyclictest0-21swapper/323:15:113
45144599200,1cyclictest3056-21PK-Backend20:08:333
45144599200,1cyclictest0-21swapper/319:49:003
45144599200,1cyclictest0-21swapper/300:28:113
45144599200,19cyclictest3056-21PK-Backend21:39:113
45144599200,19cyclictest3056-21PK-Backend00:14:523
45144599200,19cyclictest0-21swapper/323:38:023
45144599200,19cyclictest0-21swapper/321:02:073
451443992018,1cyclictest0-21swapper/222:04:242
451443992018,1cyclictest0-21swapper/221:28:352
451443992018,1cyclictest0-21swapper/220:24:122
451443992018,1cyclictest0-21swapper/219:11:202
451443992012,6cyclictest542582-21ntpq23:25:212
451443992011,7cyclictest498783-21sed21:20:182
45144399200,1cyclictest0-21swapper/222:53:112
45144399200,19cyclictest0-21swapper/223:55:432
45144399200,19cyclictest0-21swapper/222:22:222
45144399200,19cyclictest0-21swapper/221:31:392
45144399200,19cyclictest0-21swapper/221:01:312
45144399200,19cyclictest0-21swapper/220:55:432
45144399200,19cyclictest0-21swapper/220:41:162
45144399200,19cyclictest0-21swapper/219:59:532
45144399200,19cyclictest0-21swapper/219:59:522
45144399200,18cyclictest3056-21PK-Backend19:35:122
451439992018,1cyclictest3056-21PK-Backend19:19:371
451439992018,1cyclictest0-21swapper/122:10:531
451439992018,1cyclictest0-21swapper/120:37:111
451439992017,2cyclictest3056-21PK-Backend20:53:121
451439992017,2cyclictest0-21swapper/100:36:471
451439992015,3cyclictest535638-21ntp_states23:05:201
451439992014,4cyclictest2156-21gnome-shell19:26:091
45143999200,19cyclictest3056-21PK-Backend22:40:541
45143999200,19cyclictest3056-21PK-Backend22:23:021
45143999200,19cyclictest0-21swapper/123:02:581
45143999200,19cyclictest0-21swapper/121:50:171
45143999200,19cyclictest0-21swapper/120:47:171
45143999200,19cyclictest0-21swapper/120:03:161
45143999200,19cyclictest0-21swapper/119:20:251
45143999200,18cyclictest3056-21PK-Backend21:13:411
45143799202,16cyclictest563636-21tr00:25:140
451437992018,1cyclictest0-21swapper/023:46:220
451437992018,1cyclictest0-21swapper/023:46:220
451437992018,1cyclictest0-21swapper/023:23:170
451437992018,1cyclictest0-21swapper/022:45:260
451437992018,1cyclictest0-21swapper/022:05:510
451437992018,1cyclictest0-21swapper/021:17:250
451437992018,1cyclictest0-21swapper/020:58:250
451437992018,1cyclictest0-21swapper/020:51:300
451437992018,1cyclictest0-21swapper/019:51:270
451437992018,1cyclictest0-21swapper/000:14:340
451437992018,1cyclictest0-21swapper/000:01:240
451437992017,2cyclictest529769-21sort22:50:170
451437992013,6cyclictest567878-21sed00:35:240
451437992013,5cyclictest883-21dbus-daemon23:55:020
45143799200,1cyclictest0-21swapper/000:30:300
45143799200,19cyclictest0-21swapper/023:25:540
45143799200,19cyclictest0-21swapper/023:03:040
45143799200,19cyclictest0-21swapper/021:59:350
45143799200,19cyclictest0-21swapper/021:35:150
45143799200,19cyclictest0-21swapper/020:43:590
45143799200,19cyclictest0-21swapper/019:30:450
139099200,14rtkit-daemon0-21swapper/319:18:223
139099200,14rtkit-daemon0-21swapper/221:42:442
139099200,14rtkit-daemon0-21swapper/221:15:432
139099200,14rtkit-daemon0-21swapper/220:03:502
451445991917,1cyclictest0-21swapper/323:22:333
451445991917,1cyclictest0-21swapper/322:42:193
451445991917,1cyclictest0-21swapper/320:55:463
451445991917,1cyclictest0-21swapper/320:23:423
451445991917,1cyclictest0-21swapper/320:16:253
451445991912,5cyclictest481673-21awk20:30:193
45144599190,1cyclictest3056-21PK-Backend22:04:193
45144599190,1cyclictest0-21swapper/321:41:553
451443991917,1cyclictest0-21swapper/223:42:042
451443991917,1cyclictest0-21swapper/220:51:172
451443991917,1cyclictest0-21swapper/220:49:202
451443991917,1cyclictest0-21swapper/219:40:262
451443991913,4cyclictest475585-21grep20:15:132
45144399190,18cyclictest0-21swapper/200:16:112
45144399190,17cyclictest525244-21ntpq22:35:212
45143999199,9cyclictest3056-21PK-Backend00:25:001
451439991917,1cyclictest3056-21PK-Backend23:37:511
451439991917,1cyclictest3056-21PK-Backend23:22:231
451439991917,1cyclictest3056-21PK-Backend23:16:151
451439991917,1cyclictest3056-21PK-Backend20:28:171
451439991917,1cyclictest3056-21PK-Backend19:44:381
451439991917,1cyclictest0-21swapper/122:08:091
451439991917,1cyclictest0-21swapper/121:56:521
451439991917,1cyclictest0-21swapper/121:43:421
451439991917,1cyclictest0-21swapper/120:06:011
451439991917,1cyclictest0-21swapper/119:30:041
451439991917,1cyclictest0-21swapper/100:18:141
451439991914,4cyclictest26-21ksoftirqd/100:35:001
45143999190,1cyclictest3056-21PK-Backend20:24:391
45143999190,18cyclictest0-21swapper/120:43:051
451437991917,1cyclictest0-21swapper/023:19:520
451437991917,1cyclictest0-21swapper/021:32:110
451437991917,1cyclictest0-21swapper/021:21:170
451437991917,1cyclictest0-21swapper/021:12:450
451437991917,1cyclictest0-21swapper/021:02:170
451437991917,1cyclictest0-21swapper/019:35:450
451437991917,1cyclictest0-21swapper/019:22:000
451437991917,1cyclictest0-21swapper/000:16:230
451437991912,5cyclictest551068-21sed23:50:170
451437991911,6cyclictest531436-21apt22:55:110
45143799190,1cyclictest0-21swapper/022:27:200
45143799190,1cyclictest0-21swapper/022:16:400
45143799190,1cyclictest0-21swapper/021:47:200
45143799190,18cyclictest0-21swapper/022:39:510
45143799190,18cyclictest0-21swapper/021:52:470
451445991816,1cyclictest0-21swapper/323:12:203
451445991816,1cyclictest0-21swapper/322:45:303
451445991813,3cyclictest500846-21python321:25:223
451445991810,6cyclictest436-20systemd-journal20:55:003
45144399184,13cyclictest1095-21runrttasks19:25:162
451443991816,1cyclictest0-21swapper/221:53:152
451443991816,1cyclictest0-21swapper/221:38:012
451443991816,1cyclictest0-21swapper/219:51:072
451443991811,6cyclictest564764-21sshd00:28:172
451443991811,5cyclictest479941-21open_inodes20:25:222
451443991810,5cyclictest526887-21grep22:40:182
451439991816,1cyclictest0-21swapper/100:10:021
451439991811,5cyclictest467541-21grep19:50:241
45143999180,1cyclictest0-21swapper/122:52:291
451437991816,1cyclictest0-21swapper/022:22:480
451437991816,1cyclictest0-21swapper/020:34:590
451437991816,1cyclictest0-21swapper/020:00:450
451437991813,3cyclictest472717-21ntp_offset20:05:180
451437991812,4cyclictest544598-21timerwakeupswit23:30:220
451437991811,5cyclictest512731-21expr22:00:140
451437991810,6cyclictest464470-21cat19:45:010
45143799180,1cyclictest0-21swapper/022:33:320
451445991715,1cyclictest3056-21PK-Backend23:00:093
451445991715,1cyclictest3056-21PK-Backend21:47:233
451445991712,3cyclictest547183-21cut23:40:123
451445991710,6cyclictest515575-21idleruntime-cro22:10:003
45144399171,10cyclictest453619-21switchtime19:15:022
45143999176,4cyclictest554254-21runrttasks00:00:111
451439991715,1cyclictest3056-21PK-Backend22:35:131
451439991715,1cyclictest0-21swapper/122:19:301
451439991715,1cyclictest0-21swapper/122:01:331
451439991712,3cyclictest556379-21hddtemp_smartct00:05:161
451437991715,1cyclictest0-21swapper/021:09:270
451437991715,1cyclictest0-21swapper/019:56:070
451437991715,1cyclictest0-21swapper/019:56:070
451437991715,1cyclictest0-21swapper/019:14:350
451437991711,5cyclictest506240-21sed21:40:240
451437991711,4cyclictest483497-21awk20:35:200
45144399162,11cyclictest527975-21apt22:45:132
451443991614,1cyclictest0-21swapper/221:59:312
451439991614,1cyclictest3056-21PK-Backend20:57:241
45143999160,1cyclictest3056-21PK-Backend23:13:041
45143999160,14cyclictest3056-21PK-Backend23:45:361
45143999160,14cyclictest3056-21PK-Backend23:45:351
451445991510,4cyclictest3056-21PK-Backend20:35:413
45144599150,13cyclictest552468-21/usr/sbin/munin23:55:193
451439991513,1cyclictest3056-21PK-Backend21:05:501
451439991512,2cyclictest3056-21PK-Backend23:29:211
45143999147,5cyclictest502158-21if_enp2s021:30:191
451439991412,1cyclictest3056-21PK-Backend20:32:381
45143999140,6cyclictest3056-21PK-Backend19:45:021
45143799148,5cyclictest516482-21needreboot22:10:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional