You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 18:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Sat May 02, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22195623380,18sleep10-21swapper/107:05:141
30312321230,8sleep342-21ksoftirqd/310:51:533
31359921220,3sleep00-21swapper/011:20:210
29111321130,3sleep20-21swapper/210:20:002
28350521080,4sleep00-21swapper/009:59:530
31285421060,4sleep33056-21PK-Backend11:20:123
2835552960,3sleep20-21swapper/210:00:002
139099910,77rtkit-daemon0-21swapper/307:08:513
22282026939,25sleep00-21swapper/007:06:190
22283226242,14sleep20-21swapper/207:06:292
2337482520,3sleep00-21swapper/007:35:230
3060242510,4sleep23056-21PK-Backend11:00:142
2903942490,2sleep00-21swapper/010:15:220
139099380,3rtkit-daemon0-21swapper/307:11:193
22334699294,22cyclictest251726-21cron08:30:002
139099270,4rtkit-daemon1389-21rtkit-daemon11:48:491
139099270,4rtkit-daemon1389-21rtkit-daemon11:48:491
139099270,4rtkit-daemon1389-21rtkit-daemon11:39:161
139099270,4rtkit-daemon1389-21rtkit-daemon10:42:011
223338992621,3cyclictest321504-21idleruntime-cro11:45:000
22333899260,24cyclictest1389-21rtkit-daemon10:47:280
22333899260,24cyclictest1389-21rtkit-daemon10:47:280
139099260,4rtkit-daemon1389-21rtkit-daemon10:26:411
139099260,4rtkit-daemon1389-21rtkit-daemon09:02:451
223340992511,12cyclictest228734-21/usr/sbin/munin07:20:231
139099250,4rtkit-daemon1389-21rtkit-daemon12:09:431
223346992419,3cyclictest238865-21ntp_states07:50:182
22334699240,11cyclictest2744162cat09:30:242
223338992415,7cyclictest297920-21apt-get10:40:000
22333899240,22cyclictest1389-21rtkit-daemon07:41:000
22334699230,11cyclictest2522332cat08:30:132
22334099230,21cyclictest274643-21apt-get09:32:461
2855552220,2sleep10-21swapper/110:05:011
223351992219,2cyclictest3056-21PK-Backend09:20:163
223346992220,1cyclictest0-21swapper/212:20:582
223346992220,1cyclictest0-21swapper/211:44:002
223346992220,1cyclictest0-21swapper/211:15:282
223346992220,1cyclictest0-21swapper/211:09:462
223346992220,1cyclictest0-21swapper/210:51:492
223346992220,1cyclictest0-21swapper/210:35:252
223346992220,1cyclictest0-21swapper/209:44:082
22334699220,21cyclictest0-21swapper/212:12:542
22334699220,21cyclictest0-21swapper/208:59:002
22334099222,2cyclictest0-21swapper/110:51:411
223340992220,1cyclictest0-21swapper/108:55:211
223340992220,1cyclictest0-21swapper/108:28:591
223340992211,9cyclictest278362-21unin-run09:45:001
22333899220,21cyclictest1389-21rtkit-daemon10:43:540
2555622210,3sleep30-21swapper/308:40:023
223351992114,5cyclictest308237-21python311:05:223
22335199210,20cyclictest3056-21PK-Backend11:54:213
22334699218,2cyclictest141rcu_preempt09:15:002
223346992119,1cyclictest0-21swapper/211:12:362
223346992119,1cyclictest0-21swapper/210:44:312
223346992119,1cyclictest0-21swapper/210:33:372
223346992119,1cyclictest0-21swapper/210:23:092
223346992119,1cyclictest0-21swapper/210:11:532
223346992119,1cyclictest0-21swapper/210:04:032
223346992119,1cyclictest0-21swapper/209:52:002
223346992119,1cyclictest0-21swapper/209:51:592
223346992119,1cyclictest0-21swapper/208:43:052
223346992119,1cyclictest0-21swapper/208:19:532
223346992119,1cyclictest0-21swapper/207:29:022
223346992117,3cyclictest34-21ksoftirqd/211:40:002
223346992115,4cyclictest226591-21tail07:15:172
22334699210,20cyclictest3056-21PK-Backend12:08:272
22334699210,20cyclictest0-21swapper/208:39:542
223340992119,1cyclictest0-21swapper/112:01:311
223340992119,1cyclictest0-21swapper/110:31:211
223340992119,1cyclictest0-21swapper/110:07:281
223340992119,1cyclictest0-21swapper/109:36:121
223340992119,1cyclictest0-21swapper/109:27:461
223340992119,1cyclictest0-21swapper/108:24:261
223340992119,1cyclictest0-21swapper/107:42:001
223340992118,2cyclictest3056-21PK-Backend08:30:341
223340992118,2cyclictest3056-21PK-Backend07:13:221
223340992114,5cyclictest281807-21basename09:54:591
223340992114,5cyclictest281807-21basename09:54:591
223340992113,6cyclictest260173-21sed08:50:221
223340992113,6cyclictest260173-21sed08:50:211
22334099210,20cyclictest3056-21PK-Backend12:35:311
22334099210,20cyclictest3056-21PK-Backend10:47:151
22334099210,20cyclictest3056-21PK-Backend10:47:151
22334099210,20cyclictest0-21swapper/112:30:181
22334099210,20cyclictest0-21swapper/111:27:251
22334099210,20cyclictest0-21swapper/110:21:541
22334099210,19cyclictest0-21swapper/110:58:451
22334099210,19cyclictest0-21swapper/107:55:331
22334099210,19cyclictest0-21swapper/107:55:331
223338992113,6cyclictest294455-21cron10:30:000
223338992110,9cyclictest331920-21unin-run12:15:000
22333899210,1cyclictest0-21swapper/009:09:360
139099210,3rtkit-daemon1389-21rtkit-daemon12:34:060
223351992018,1cyclictest3056-21PK-Backend11:13:193
223351992012,6cyclictest249405-21python308:20:203
22335199200,1cyclictest0-21swapper/311:40:293
223346992018,1cyclictest3056-21PK-Backend08:10:272
223346992018,1cyclictest0-21swapper/212:19:092
223346992018,1cyclictest0-21swapper/211:55:562
223346992018,1cyclictest0-21swapper/211:26:372
223346992018,1cyclictest0-21swapper/209:19:412
223346992018,1cyclictest0-21swapper/208:47:042
223346992014,4cyclictest301643-21sh10:50:002
223346992014,4cyclictest301643-21sh10:49:592
223346992011,7cyclictest224446-21ntp_states07:10:192
22334699200,19cyclictest0-21swapper/212:28:002
22334699200,19cyclictest0-21swapper/209:46:452
22334699200,19cyclictest0-21swapper/208:24:252
22334699200,19cyclictest0-21swapper/207:35:122
223340992018,1cyclictest3056-21PK-Backend12:17:121
223340992018,1cyclictest3056-21PK-Backend11:50:501
223340992018,1cyclictest3056-21PK-Backend10:36:351
223340992018,1cyclictest0-21swapper/111:00:341
223340992018,1cyclictest0-21swapper/109:48:481
223340992018,1cyclictest0-21swapper/109:08:061
223340992018,1cyclictest0-21swapper/108:02:151
223340992018,1cyclictest0-21swapper/107:32:081
223340992018,1cyclictest0-21swapper/107:16:401
223340992013,5cyclictest291151-21sed10:20:001
22334099200,1cyclictest3056-21PK-Backend09:55:371
22334099200,19cyclictest3056-21PK-Backend08:39:401
22334099200,19cyclictest0-21swapper/112:28:291
22334099200,19cyclictest0-21swapper/111:55:161
22334099200,19cyclictest0-21swapper/111:31:031
22334099200,19cyclictest0-21swapper/109:24:211
22334099200,19cyclictest0-21swapper/109:14:151
22334099200,19cyclictest0-21swapper/108:06:211
223338992018,1cyclictest0-21swapper/012:19:310
223338992018,1cyclictest0-21swapper/009:29:320
223338992018,1cyclictest0-21swapper/009:23:440
223338992018,1cyclictest0-21swapper/008:32:060
223338992015,3cyclictest276586-21cron09:40:000
223338992013,6cyclictest326213-21sed11:55:210
223338992013,5cyclictest337097-21cron12:30:000
22333899200,7cyclictest263046-21df_inode09:00:140
22333899200,1cyclictest0-21swapper/011:03:070
22333899200,1cyclictest0-21swapper/009:12:010
22333899200,19cyclictest3056-21PK-Backend08:43:340
22333899200,19cyclictest3056-21PK-Backend07:22:360
22333899200,19cyclictest0-21swapper/011:30:150
22333899200,19cyclictest0-21swapper/011:12:470
22333899200,19cyclictest0-21swapper/010:31:290
22333899200,19cyclictest0-21swapper/009:33:430
22333899200,19cyclictest0-21swapper/009:19:450
22333899200,19cyclictest0-21swapper/007:28:180
22333899200,19cyclictest0-21swapper/007:19:520
22333899200,19cyclictest0-21swapper/007:13:170
3407882190,3sleep33056-21PK-Backend12:40:013
223351991917,1cyclictest3056-21PK-Backend09:51:053
223351991917,1cyclictest3056-21PK-Backend09:51:053
223351991916,2cyclictest3056-21PK-Backend12:29:083
223351991916,2cyclictest3056-21PK-Backend10:43:103
223351991916,2cyclictest3056-21PK-Backend10:31:403
223351991914,3cyclictest242343-21ntp_states08:00:193
223351991914,3cyclictest226793-21python307:15:203
223351991913,5cyclictest244193-21rt-features08:05:243
22335199191,1cyclictest0-21swapper/308:30:553
22335199191,16cyclictest229876-21irqstats07:25:163
22335199191,13cyclictest239867-21apt07:55:123
22335199191,13cyclictest239867-21apt07:55:123
223351991910,7cyclictest883-21dbus-daemon09:20:013
22335199190,1cyclictest0-21swapper/312:33:413
22335199190,1cyclictest0-21swapper/308:48:393
22334699194,2cyclictest141rcu_preempt09:24:532
223346991917,1cyclictest0-21swapper/212:38:412
223346991917,1cyclictest0-21swapper/212:31:382
223346991917,1cyclictest0-21swapper/212:04:002
223346991917,1cyclictest0-21swapper/211:50:302
223346991917,1cyclictest0-21swapper/211:45:022
223346991917,1cyclictest0-21swapper/211:45:012
223346991917,1cyclictest0-21swapper/209:07:122
223346991917,1cyclictest0-21swapper/208:51:022
223346991917,1cyclictest0-21swapper/208:51:022
223346991917,1cyclictest0-21swapper/207:34:232
223346991912,5cyclictest1095-21runrttasks08:00:142
223340991917,1cyclictest0-21swapper/111:42:451
223340991917,1cyclictest0-21swapper/111:21:081
223340991914,3cyclictest236463-21cpuspeed07:45:131
22334099190,1cyclictest3056-21PK-Backend08:49:001
22334099190,1cyclictest0-21swapper/108:11:151
22334099190,1cyclictest0-21swapper/107:35:521
22334099190,18cyclictest0-21swapper/111:14:391
223338991917,1cyclictest3056-21PK-Backend11:35:250
223338991917,1cyclictest3056-21PK-Backend08:20:500
223338991917,1cyclictest0-21swapper/011:52:200
223338991917,1cyclictest0-21swapper/011:09:080
223338991917,1cyclictest0-21swapper/010:21:150
223338991917,1cyclictest0-21swapper/010:11:020
223338991917,1cyclictest0-21swapper/010:04:120
223338991917,1cyclictest0-21swapper/009:47:230
223338991916,2cyclictest3056-21PK-Backend08:28:210
223338991914,3cyclictest2156-21gnome-shell10:53:080
223338991913,5cyclictest262405-21cron09:00:000
223338991911,6cyclictest314511-21cat11:25:120
22333899190,1cyclictest0-21swapper/010:08:250
22333899190,1cyclictest0-21swapper/007:32:030
22333899190,18cyclictest0-21swapper/008:08:260
2881302180,4sleep33056-21PK-Backend10:10:123
2351602180,4sleep20-21swapper/207:40:182
22335199186,11cyclictest42-21ksoftirqd/309:15:003
223351991816,1cyclictest3056-21PK-Backend12:22:263
223351991816,1cyclictest0-21swapper/307:45:323
223351991813,3cyclictest282430-21df_inode09:55:123
223351991812,5cyclictest301238-21cat10:45:233
223351991812,5cyclictest301238-21cat10:45:233
223351991812,5cyclictest257226-21systemctl08:44:593
223351991812,4cyclictest886-21NetworkManager08:19:593
223351991812,4cyclictest436-20systemd-journal12:20:003
22335199181,15cyclictest285522-21sh10:04:593
22335199180,16cyclictest3173132sleep311:32:443
223346991816,1cyclictest0-21swapper/210:57:162
223346991816,1cyclictest0-21swapper/210:05:512
223346991816,1cyclictest0-21swapper/209:26:182
223346991816,1cyclictest0-21swapper/207:59:522
223346991816,1cyclictest0-21swapper/207:59:522
223346991813,3cyclictest312728-21cpuspeed_turbos11:20:132
223340991816,1cyclictest3056-21PK-Backend11:08:251
223340991816,1cyclictest3056-21PK-Backend09:18:141
223340991816,1cyclictest3056-21PK-Backend07:50:471
223340991816,1cyclictest3056-21PK-Backend07:26:131
223340991816,1cyclictest0-21swapper/108:15:341
223338991816,1cyclictest3056-21PK-Backend08:45:580
223338991816,1cyclictest0-21swapper/012:23:570
223338991816,1cyclictest0-21swapper/012:00:260
223338991816,1cyclictest0-21swapper/011:45:180
223338991816,1cyclictest0-21swapper/011:45:170
223338991816,1cyclictest0-21swapper/010:56:160
223338991816,1cyclictest0-21swapper/009:44:460
223338991816,1cyclictest0-21swapper/008:12:450
223338991813,4cyclictest13-21ksoftirqd/008:50:210
223338991813,4cyclictest13-21ksoftirqd/008:50:210
223338991813,3cyclictest254881-21switchtime08:35:200
22333899181,13cyclictest246807-21apt08:15:110
22333899180,4cyclictest330160-21turbostat12:10:010
22333899180,1cyclictest0-21swapper/011:18:130
22333899180,1cyclictest0-21swapper/007:49:060
22335199175,11cyclictest280079-21turbostat09:50:003
223351991715,1cyclictest3056-21PK-Backend12:05:513
223351991715,1cyclictest3056-21PK-Backend11:15:423
223351991715,1cyclictest0-21swapper/311:35:093
223351991714,2cyclictest3056-21PK-Backend08:50:493
223351991714,2cyclictest3056-21PK-Backend08:50:493
223351991713,3cyclictest250278-21apt08:25:123
223351991710,5cyclictest306183-21wc11:00:163
22335199170,15cyclictest3056-21PK-Backend09:07:243
22334699172,11cyclictest978-21snmpd11:30:202
223346991715,1cyclictest0-21swapper/209:36:322
223346991715,1cyclictest0-21swapper/208:08:172
223340991715,1cyclictest3056-21PK-Backend08:42:041
223340991715,1cyclictest0-21swapper/110:10:051
223340991711,4cyclictest26-21ksoftirqd/111:15:151
223338991714,2cyclictest241351-21idleruntime-cro08:00:000
223338991714,2cyclictest241351-21idleruntime-cro08:00:000
223351991614,1cyclictest3056-21PK-Backend10:27:553
223351991614,1cyclictest3056-21PK-Backend08:55:433
223351991614,1cyclictest0-21swapper/307:50:253
223351991613,2cyclictest3056-21PK-Backend08:13:033
223351991613,2cyclictest3056-21PK-Backend07:41:273
223351991612,2cyclictest326935-21/usr/sbin/munin12:00:113
22335199160,3cyclictest3230072sleep311:47:243
22335199160,3cyclictest3230072sleep311:47:243
22335199160,3cyclictest296855-21hddtemp_smartct10:35:153
22335199160,14cyclictest303647-21apt10:55:103
22334699163,8cyclictest227670-21apt07:20:132
22334099162,12cyclictest331880-21cron12:15:001
223340991614,1cyclictest0-21swapper/112:22:271
22333899169,6cyclictest280444-21cat09:50:120
22333899169,6cyclictest280444-21cat09:50:120
223338991611,4cyclictest243155-21ls08:05:010
223338991610,4cyclictest238333-21cstates07:50:130
2631912150,2sleep23056-21PK-Backend09:00:182
223351991513,1cyclictest3056-21PK-Backend10:06:393
223351991513,1cyclictest3056-21PK-Backend09:38:413
223351991513,1cyclictest3056-21PK-Backend07:32:083
223351991511,3cyclictest331908-21idleruntime-cro12:15:013
22335199150,14cyclictest3056-21PK-Backend10:24:113
22335199150,13cyclictest3056-21PK-Backend07:35:263
22335199150,13cyclictest228405-21ntp_states07:20:193
223346991513,1cyclictest0-21swapper/210:27:362
223338991513,1cyclictest3056-21PK-Backend12:35:270
2734932140,2sleep33056-21PK-Backend09:30:143
223351991412,1cyclictest3056-21PK-Backend09:26:323
223351991410,3cyclictest3056-21PK-Backend09:03:383
22335199140,1cyclictest3056-21PK-Backend09:43:013
22335199140,13cyclictest3056-21PK-Backend11:55:563
22335199140,13cyclictest3056-21PK-Backend10:19:043
22334699140,6cyclictest3056-21PK-Backend07:45:122
22335199120,11cyclictest3056-21PK-Backend11:27:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional