You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 01:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Sun May 31, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
413507121290,2sleep00-21swapper/011:00:230
409811121240,3sleep20-21swapper/209:15:182
413778621140,2sleep00-21swapper/011:10:120
407983621130,3sleep20-21swapper/208:25:172
139099850,72rtkit-daemon0-21swapper/307:08:163
139099700,56rtkit-daemon0-21swapper/207:05:052
405010726645,14sleep00-21swapper/007:05:110
405153326547,13sleep10-21swapper/107:09:191
40760312490,1sleep00-21swapper/008:15:130
41116262450,3sleep20-21swapper/209:55:112
41257022370,4sleep20-21swapper/210:35:132
4051808992719,6cyclictest436-20systemd-journal07:32:341
4051808992715,8cyclictest436-20systemd-journal11:39:591
405180499251,22cyclictest4127497-21diskstats10:40:140
405180899241,21cyclictest4082455-21munin-run08:34:591
4051810992314,6cyclictest28650irq/123-ahci[0007:40:212
405180899232,15cyclictest4151666-21seq11:50:101
405180899232,15cyclictest1095-21runrttasks11:05:121
4051808992315,5cyclictest4138985-21turbostat.cron11:15:001
4051808992314,7cyclictest4070055-21apt-get08:00:001
4051808992311,8cyclictest2164-21gdbus09:33:371
405180899230,21cyclictest1788620-21WebKitWebProces09:46:041
405180499230,21cyclictest4161071-21ntp_states12:15:180
41542622220,3sleep10-21swapper/111:55:201
405181699220,20cyclictest3056-21PK-Backend11:51:503
405181699220,20cyclictest3056-21PK-Backend11:36:093
405181699220,20cyclictest3056-21PK-Backend10:25:043
405181699220,20cyclictest3056-21PK-Backend09:06:503
4051810992220,1cyclictest0-21swapper/211:35:442
4051810992220,1cyclictest0-21swapper/211:18:282
4051810992220,1cyclictest0-21swapper/210:47:182
4051810992220,1cyclictest0-21swapper/209:32:022
4051810992220,1cyclictest0-21swapper/207:50:412
4051810992220,1cyclictest0-21swapper/207:33:252
4051810992214,6cyclictest436-20systemd-journal11:45:012
4051810992211,8cyclictest883-21dbus-daemon12:28:392
405181099220,21cyclictest0-21swapper/210:53:262
405181099220,21cyclictest0-21swapper/210:40:212
405181099220,21cyclictest0-21swapper/209:26:412
4051808992220,1cyclictest0-21swapper/107:16:191
4051808992214,6cyclictest4128855-21apt10:45:121
4051808992214,5cyclictest4072969-21needreboot08:05:181
4051808992213,7cyclictest4107769-21cron09:44:591
4051808992213,7cyclictest4107769-21cron09:44:591
4051808992213,7cyclictest4077122-21sshd08:18:341
4051808992210,8cyclictest4100573-21perf09:25:001
405180499220,9cyclictest41116292wc09:55:110
139099220,14rtkit-daemon3056-21PK-Backend07:33:523
139099220,14rtkit-daemon0-21swapper/210:27:312
4051816992119,1cyclictest3056-21PK-Backend10:38:443
4051816992118,2cyclictest3056-21PK-Backend07:55:063
405181699210,20cyclictest3056-21PK-Backend08:53:263
405181699210,20cyclictest0-21swapper/307:38:013
405181699210,19cyclictest3056-21PK-Backend12:36:523
405181699210,19cyclictest3056-21PK-Backend12:36:523
405181699210,19cyclictest3056-21PK-Backend11:30:003
405181699210,19cyclictest3056-21PK-Backend11:06:493
405181699210,19cyclictest3056-21PK-Backend11:02:153
405181699210,19cyclictest3056-21PK-Backend10:30:253
405181699210,19cyclictest3056-21PK-Backend10:24:173
405181699210,19cyclictest0-21swapper/309:10:353
4051810992119,1cyclictest3056-21PK-Backend08:15:082
4051810992119,1cyclictest0-21swapper/211:33:212
4051810992119,1cyclictest0-21swapper/210:10:132
4051810992119,1cyclictest0-21swapper/210:08:382
4051810992119,1cyclictest0-21swapper/210:02:292
4051810992119,1cyclictest0-21swapper/209:01:332
4051810992119,1cyclictest0-21swapper/208:44:092
4051810992119,1cyclictest0-21swapper/208:44:082
4051810992119,1cyclictest0-21swapper/208:32:202
4051810992119,1cyclictest0-21swapper/208:01:572
4051810992119,1cyclictest0-21swapper/207:56:092
4051810992119,1cyclictest0-21swapper/207:38:192
4051810992119,1cyclictest0-21swapper/207:20:332
405181099210,20cyclictest0-21swapper/210:55:012
405181099210,20cyclictest0-21swapper/209:11:262
405181099210,1cyclictest0-21swapper/209:36:342
405181099210,1cyclictest0-21swapper/209:36:342
405181099210,19cyclictest3056-21PK-Backend11:50:042
405180899213,12cyclictest4151425-21munin-run11:50:011
4051808992119,1cyclictest0-21swapper/112:06:571
4051808992119,1cyclictest0-21swapper/112:04:341
4051808992119,1cyclictest0-21swapper/111:40:071
4051808992119,1cyclictest0-21swapper/110:30:461
4051808992119,1cyclictest0-21swapper/109:11:301
4051808992119,1cyclictest0-21swapper/109:06:571
4051808992119,1cyclictest0-21swapper/108:24:261
4051808992119,1cyclictest0-21swapper/108:02:071
4051808992115,3cyclictest2156-21gnome-shell10:10:091
4051808992112,7cyclictest4159339-21ntp_states12:10:191
405180899210,8cyclictest41350742sort11:00:221
405180899210,20cyclictest3056-21PK-Backend11:23:051
405180899210,20cyclictest0-21swapper/111:16:071
405180899210,20cyclictest0-21swapper/110:52:561
405180899210,20cyclictest0-21swapper/110:01:051
405180899210,20cyclictest0-21swapper/108:54:531
4051804992114,5cyclictest4151571-21date11:50:000
405180499210,20cyclictest3056-21PK-Backend08:05:550
405180499210,20cyclictest0-21swapper/010:57:510
405180499210,20cyclictest0-21swapper/010:04:250
405180499210,20cyclictest0-21swapper/007:14:240
139099210,15rtkit-daemon3056-21PK-Backend10:02:363
139099210,14rtkit-daemon3056-21PK-Backend11:45:173
139099210,14rtkit-daemon3056-21PK-Backend10:53:253
41579172200,3sleep20-21swapper/212:05:252
4051816992018,1cyclictest3056-21PK-Backend09:00:083
4051816992017,2cyclictest3056-21PK-Backend09:54:023
4051816992015,3cyclictest4087956-21munin-run08:50:003
405181699200,1cyclictest3056-21PK-Backend09:57:473
405181699200,1cyclictest3056-21PK-Backend08:19:053
405181699200,19cyclictest3056-21PK-Backend12:12:183
405181699200,19cyclictest3056-21PK-Backend10:19:443
405181699200,19cyclictest3056-21PK-Backend07:46:403
405181699200,19cyclictest3056-21PK-Backend07:20:323
405181699200,19cyclictest0-21swapper/311:43:533
405181699200,19cyclictest0-21swapper/309:22:403
405181699200,19cyclictest0-21swapper/307:25:463
405181699200,18cyclictest3056-21PK-Backend08:20:263
4051810992018,1cyclictest0-21swapper/208:47:532
4051810992018,1cyclictest0-21swapper/207:49:542
4051810992018,1cyclictest0-21swapper/207:19:112
4051810992016,3cyclictest34-21ksoftirqd/207:30:002
4051810992013,5cyclictest436-20systemd-journal12:20:182
4051810992012,6cyclictest436-20systemd-journal09:25:002
405181099200,1cyclictest0-21swapper/209:51:012
405181099200,1cyclictest0-21swapper/208:10:302
405181099200,19cyclictest0-21swapper/212:16:332
405181099200,19cyclictest0-21swapper/211:29:222
405181099200,19cyclictest0-21swapper/211:05:092
405181099200,19cyclictest0-21swapper/211:03:332
4051808992018,1cyclictest3056-21PK-Backend07:41:401
4051808992018,1cyclictest3056-21PK-Backend07:38:081
4051808992018,1cyclictest0-21swapper/112:36:181
4051808992018,1cyclictest0-21swapper/112:36:181
4051808992018,1cyclictest0-21swapper/112:19:421
4051808992018,1cyclictest0-21swapper/110:20:041
4051808992018,1cyclictest0-21swapper/109:50:361
4051808992018,1cyclictest0-21swapper/109:19:471
4051808992018,1cyclictest0-21swapper/108:40:551
4051808992018,1cyclictest0-21swapper/108:40:551
4051808992017,2cyclictest3056-21PK-Backend08:35:471
4051808992013,5cyclictest4162421-21expr12:20:131
4051808992013,5cyclictest2156-21gnome-shell07:47:091
405180899200,1cyclictest0-21swapper/110:35:181
405180899200,1cyclictest0-21swapper/110:08:351
405180899200,19cyclictest3056-21PK-Backend08:48:591
405180899200,19cyclictest0-21swapper/111:31:351
405180899200,19cyclictest0-21swapper/111:29:121
405180899200,19cyclictest0-21swapper/107:21:451
4051804992018,1cyclictest3056-21PK-Backend11:24:480
4051804992018,1cyclictest0-21swapper/012:21:540
4051804992018,1cyclictest0-21swapper/012:13:420
4051804992015,3cyclictest4155112-21find12:00:080
4051804992015,3cyclictest4107059-21ntp_states09:40:190
4051804992015,3cyclictest4107059-21ntp_states09:40:190
4051804992014,4cyclictest4130321-21idleruntime-cro10:50:000
4051804992012,6cyclictest4157312-21cat12:05:180
4051804992012,6cyclictest4084475-21systemctl08:39:590
405180499200,19cyclictest3056-21PK-Backend07:26:080
405180499200,19cyclictest0-21swapper/011:36:310
405180499200,19cyclictest0-21swapper/011:34:090
405180499200,19cyclictest0-21swapper/011:26:250
405180499200,19cyclictest0-21swapper/011:18:400
405180499200,19cyclictest0-21swapper/010:51:430
405180499200,19cyclictest0-21swapper/010:28:450
405180499200,19cyclictest0-21swapper/010:20:270
405180499200,19cyclictest0-21swapper/010:18:510
405180499200,19cyclictest0-21swapper/009:50:460
405180499200,19cyclictest0-21swapper/009:34:100
405180499200,19cyclictest0-21swapper/009:13:480
405180499200,19cyclictest0-21swapper/008:22:250
405180499200,19cyclictest0-21swapper/008:00:080
405180499200,18cyclictest3056-21PK-Backend10:10:340
405180499200,18cyclictest0-21swapper/009:22:540
139099200,14rtkit-daemon3056-21PK-Backend10:47:003
139099200,14rtkit-daemon3056-21PK-Backend07:12:333
139099200,14rtkit-daemon0-21swapper/208:57:322
139099200,14rtkit-daemon0-21swapper/208:20:472
40863972190,4sleep0161rcuc/008:45:000
40863972190,4sleep0161rcuc/008:45:000
4051816991917,1cyclictest0-21swapper/309:18:073
4051816991917,1cyclictest0-21swapper/308:10:333
4051816991916,1cyclictest3056-21PK-Backend08:44:333
4051816991916,1cyclictest3056-21PK-Backend08:44:333
4051816991915,3cyclictest4083843-21python308:35:203
4051816991912,5cyclictest883-21dbus-daemon12:28:393
4051816991911,6cyclictest4108908-21python309:45:213
4051816991911,6cyclictest4073377-21sed08:05:233
405181699190,1cyclictest3056-21PK-Backend09:39:013
405181699190,1cyclictest3056-21PK-Backend09:39:013
405181699190,1cyclictest3056-21PK-Backend08:56:233
405181699190,1cyclictest0-21swapper/310:13:363
405181699190,1cyclictest0-21swapper/308:31:223
405181699190,18cyclictest0-21swapper/312:30:173
405181699190,18cyclictest0-21swapper/307:40:113
4051810991917,1cyclictest0-21swapper/212:11:002
4051810991917,1cyclictest0-21swapper/210:32:372
4051810991913,5cyclictest4165995-21cat12:30:142
405181099190,1cyclictest0-21swapper/211:20:022
405181099190,1cyclictest0-21swapper/208:51:382
405181099190,1cyclictest0-21swapper/208:09:082
405181099190,1cyclictest0-21swapper/207:14:042
405181099190,18cyclictest0-21swapper/209:46:282
405180899192,12cyclictest4089909-21apt-get08:55:031
4051808991917,1cyclictest3056-21PK-Backend09:25:081
4051808991917,1cyclictest0-21swapper/110:55:201
4051808991917,1cyclictest0-21swapper/109:35:371
4051808991917,1cyclictest0-21swapper/109:35:371
4051808991917,1cyclictest0-21swapper/109:00:141
405180899190,1cyclictest3056-21PK-Backend10:18:281
405180899190,1cyclictest0-21swapper/112:30:301
405180899190,1cyclictest0-21swapper/107:11:591
405180899190,18cyclictest0-21swapper/110:28:231
4051804991917,1cyclictest0-21swapper/012:29:180
4051804991917,1cyclictest0-21swapper/010:30:200
4051804991917,1cyclictest0-21swapper/010:09:460
4051804991917,1cyclictest0-21swapper/009:19:100
4051804991917,1cyclictest0-21swapper/009:04:430
4051804991917,1cyclictest0-21swapper/008:58:010
4051804991917,1cyclictest0-21swapper/008:54:160
4051804991917,1cyclictest0-21swapper/008:45:230
4051804991917,1cyclictest0-21swapper/008:25:090
4051804991917,1cyclictest0-21swapper/007:58:120
4051804991917,1cyclictest0-21swapper/007:17:230
4051804991912,5cyclictest4067076-21cat07:50:130
405180499190,1cyclictest0-21swapper/009:05:300
405180499190,18cyclictest0-21swapper/010:39:270
405180499190,18cyclictest0-21swapper/008:33:330
405180499190,18cyclictest0-21swapper/007:36:280
40713422180,3sleep33056-21PK-Backend08:00:213
405181699185,11cyclictest42-21ksoftirqd/309:25:093
4051816991815,2cyclictest3056-21PK-Backend12:16:173
4051816991815,2cyclictest3056-21PK-Backend11:55:493
4051816991815,2cyclictest3056-21PK-Backend10:40:203
4051816991815,2cyclictest3056-21PK-Backend08:25:073
4051810991816,1cyclictest0-21swapper/210:23:192
4051810991816,1cyclictest0-21swapper/209:06:542
405181099180,5cyclictest41377872expr11:10:132
4051808991816,1cyclictest3056-21PK-Backend07:29:091
4051808991816,1cyclictest0-21swapper/109:57:201
4051808991813,4cyclictest4068340-21perf07:55:011
4051808991811,5cyclictest4074529-21awk08:10:151
4051804991816,1cyclictest0-21swapper/008:14:270
4051804991816,1cyclictest0-21swapper/007:47:170
4051804991816,1cyclictest0-21swapper/007:24:460
4051804991811,5cyclictest4154107-21ntpq11:55:190
405180499180,1cyclictest0-21swapper/009:26:390
4051816991715,1cyclictest0-21swapper/311:30:493
4051816991714,2cyclictest4140114-21smartctl11:15:203
405181699170,2cyclictest41421372sleep311:21:103
405181099178,7cyclictest4119199-21ntp_states10:15:212
4051810991715,1cyclictest0-21swapper/209:42:422
4051810991715,1cyclictest0-21swapper/209:42:422
4051810991710,5cyclictest436-20systemd-journal11:47:342
4051810991710,5cyclictest4084037-21cat08:35:232
4051808991715,1cyclictest0-21swapper/110:42:141
4051808991711,5cyclictest4079681-21basename08:25:161
4051804991715,1cyclictest0-21swapper/012:39:180
4051804991715,1cyclictest0-21swapper/012:39:180
4051804991715,1cyclictest0-21swapper/009:47:010
4051804991715,1cyclictest0-21swapper/009:35:450
4051804991715,1cyclictest0-21swapper/009:35:450
4051804991715,1cyclictest0-21swapper/007:40:470
4051804991711,5cyclictest4152140-21awk11:50:150
4051804991711,4cyclictest4149684-21date11:45:000
4051804991710,5cyclictest4060025-21grep07:30:120
4051816991614,1cyclictest3056-21PK-Backend07:16:253
4051816991610,5cyclictest42-21ksoftirqd/312:09:343
4051810991614,1cyclictest0-21swapper/212:37:372
4051810991614,1cyclictest0-21swapper/212:37:362
405181099160,6cyclictest4155621-21grep12:00:142
405181099160,15cyclictest4153543-21sshd11:55:122
4051808991614,1cyclictest3056-21PK-Backend12:28:541
405180499168,6cyclictest4136368-21memory11:05:170
405181699159,4cyclictest4155994-21python312:00:193
4051816991513,1cyclictest3056-21PK-Backend12:24:293
4051816991513,1cyclictest3056-21PK-Backend11:13:453
4051816991513,1cyclictest3056-21PK-Backend10:58:303
4051816991513,1cyclictest3056-21PK-Backend09:40:383
4051816991513,1cyclictest3056-21PK-Backend09:40:383
4051816991513,1cyclictest3056-21PK-Backend09:30:573
4051816991513,1cyclictest3056-21PK-Backend07:51:473
4051816991512,2cyclictest3056-21PK-Backend10:06:533
4051804991510,3cyclictest4167096-21cat12:35:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional