You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-08 - 00:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri Aug 07, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
56235822310,21sleep30-21swapper/307:05:113
58280121370,2sleep13056-21PK-Backend08:00:161
58280121370,2sleep13056-21PK-Backend08:00:161
139099950,60rtkit-daemon0-21swapper/007:05:070
56233327145,17sleep20-21swapper/207:05:112
56351726140,14sleep10-21swapper/107:06:181
5969492470,4sleep23056-21PK-Backend08:40:152
6659552450,2sleep20-21swapper/211:55:232
6193302420,7sleep00-21swapper/009:45:130
139099410,3rtkit-daemon0-21swapper/107:53:351
5751202300,4sleep33056-21PK-Backend07:40:013
56408199289,6cyclictest601050-21sed08:50:213
6639172270,4chrt3056-21PK-Backend11:50:182
564081992610,4cyclictest679083-21tr12:35:123
139099260,18rtkit-daemon0-21swapper/311:40:193
56408199258,15cyclictest586000-21expr08:10:123
56408199257,16cyclictest578542-21cron07:50:003
564062992415,7cyclictest592403-21cron08:30:000
564081992315,6cyclictest665784-21ntp_kernel_pll_11:55:193
56408199231,20cyclictest622679-21apt09:55:113
564068992321,1cyclictest0-21swapper/110:50:241
56406899230,21cyclictest3056-21PK-Backend09:22:161
564062992314,6cyclictest436-20systemd-journal11:55:000
139099230,16rtkit-daemon3056-21PK-Backend08:11:511
6299742220,17sleep20-21swapper/210:15:142
564081992220,1cyclictest3056-21PK-Backend10:53:313
564081992220,1cyclictest3056-21PK-Backend09:13:413
564081992220,1cyclictest0-21swapper/309:43:153
564081992220,1cyclictest0-21swapper/309:23:073
564081992220,1cyclictest0-21swapper/308:17:513
56408199221,5cyclictest637069-21apt10:35:123
56408199220,21cyclictest3056-21PK-Backend08:34:133
56408199220,21cyclictest0-21swapper/311:26:233
56408199220,20cyclictest638803-21apt10:40:133
56408199220,20cyclictest436-20systemd-journal10:02:473
564076992220,1cyclictest0-21swapper/212:20:492
564076992220,1cyclictest0-21swapper/211:30:402
564076992220,1cyclictest0-21swapper/210:52:002
564076992219,2cyclictest0-21swapper/207:22:122
56407699220,20cyclictest0-21swapper/208:00:312
56407699220,20cyclictest0-21swapper/208:00:312
564068992220,1cyclictest0-21swapper/111:17:011
564068992219,2cyclictest3056-21PK-Backend09:48:191
139099220,15rtkit-daemon3056-21PK-Backend10:15:043
139099220,15rtkit-daemon3056-21PK-Backend07:44:451
139099220,14rtkit-daemon0-21swapper/107:38:341
564081992119,1cyclictest3056-21PK-Backend12:24:433
564081992119,1cyclictest3056-21PK-Backend11:24:133
564081992119,1cyclictest3056-21PK-Backend10:59:473
564081992119,1cyclictest3056-21PK-Backend10:07:283
564081992119,1cyclictest3056-21PK-Backend10:07:273
564081992119,1cyclictest3056-21PK-Backend08:45:423
564081992119,1cyclictest0-21swapper/311:35:023
564081992119,1cyclictest0-21swapper/309:39:433
564081992119,1cyclictest0-21swapper/307:59:323
564081992119,1cyclictest0-21swapper/307:34:183
564081992118,2cyclictest612946-21strings09:25:173
564081992118,2cyclictest3056-21PK-Backend09:04:283
564081992114,6cyclictest619794-21memory09:45:173
564081992113,6cyclictest657151-21ntpq11:30:203
56408199210,20cyclictest3056-21PK-Backend10:13:303
56408199210,20cyclictest0-21swapper/309:15:503
56408199210,20cyclictest0-21swapper/307:23:363
56408199210,19cyclictest3056-21PK-Backend07:41:073
564076992119,1cyclictest0-21swapper/212:25:552
564076992119,1cyclictest0-21swapper/211:29:522
564076992119,1cyclictest0-21swapper/211:23:232
564076992119,1cyclictest0-21swapper/211:13:232
564076992119,1cyclictest0-21swapper/210:41:262
564076992119,1cyclictest0-21swapper/210:39:152
564076992119,1cyclictest0-21swapper/210:22:402
564076992119,1cyclictest0-21swapper/209:47:182
564076992119,1cyclictest0-21swapper/209:15:342
564076992119,1cyclictest0-21swapper/209:14:462
564076992119,1cyclictest0-21swapper/208:35:262
564076992119,1cyclictest0-21swapper/208:32:422
56407699210,20cyclictest0-21swapper/211:41:282
56407699210,20cyclictest0-21swapper/210:01:242
56407699210,20cyclictest0-21swapper/209:22:512
56407699210,20cyclictest0-21swapper/208:53:582
56407699210,20cyclictest0-21swapper/207:38:552
56407699210,19cyclictest0-21swapper/211:15:322
564068992119,1cyclictest3056-21PK-Backend11:39:171
564068992119,1cyclictest3056-21PK-Backend10:32:531
564068992119,1cyclictest3056-21PK-Backend09:52:231
564068992119,1cyclictest0-21swapper/112:31:491
564068992119,1cyclictest0-21swapper/110:55:181
564068992119,1cyclictest0-21swapper/110:14:351
564068992119,1cyclictest0-21swapper/110:05:501
564068992119,1cyclictest0-21swapper/110:05:501
564068992119,1cyclictest0-21swapper/109:06:011
564068992119,1cyclictest0-21swapper/109:06:011
564068992119,1cyclictest0-21swapper/108:55:261
564068992119,1cyclictest0-21swapper/108:28:431
564068992119,1cyclictest0-21swapper/107:55:101
564068992118,2cyclictest3056-21PK-Backend12:04:121
564068992113,6cyclictest623666-21sed09:55:221
56406899210,20cyclictest0-21swapper/112:27:311
56406899210,20cyclictest0-21swapper/111:45:471
56406899210,20cyclictest0-21swapper/109:00:201
56406899210,20cyclictest0-21swapper/108:35:461
56406899210,19cyclictest6318302sleep110:20:021
56406899210,19cyclictest3056-21PK-Backend11:34:251
56406899210,19cyclictest3056-21PK-Backend09:42:171
56406899210,19cyclictest3056-21PK-Backend09:37:371
56406899210,19cyclictest3056-21PK-Backend07:27:321
139099210,15rtkit-daemon3056-21PK-Backend11:13:403
139099210,14rtkit-daemon3056-21PK-Backend08:20:241
139099210,14rtkit-daemon3056-21PK-Backend08:15:250
564081992018,1cyclictest3056-21PK-Backend11:04:393
564081992018,1cyclictest3056-21PK-Backend08:42:593
564081992018,1cyclictest0-21swapper/308:00:203
564081992018,1cyclictest0-21swapper/308:00:203
564081992018,1cyclictest0-21swapper/307:28:163
564081992018,1cyclictest0-21swapper/307:19:583
56408199200,1cyclictest3056-21PK-Backend08:38:533
56408199200,19cyclictest3056-21PK-Backend12:29:033
56408199200,19cyclictest3056-21PK-Backend10:29:033
56408199200,19cyclictest0-21swapper/312:10:583
564076992018,1cyclictest0-21swapper/209:54:212
564076992018,1cyclictest0-21swapper/209:34:002
564076992018,1cyclictest0-21swapper/207:12:182
564076992017,2cyclictest0-21swapper/209:43:462
564076992013,6cyclictest28650irq/123-ahci[0008:25:212
564076992010,8cyclictest589967-21awk08:20:192
56407699200,1cyclictest0-21swapper/208:07:482
56407699200,19cyclictest0-21swapper/212:15:422
56407699200,19cyclictest0-21swapper/212:10:352
56407699200,19cyclictest0-21swapper/212:09:472
56407699200,19cyclictest0-21swapper/212:04:392
56407699200,19cyclictest0-21swapper/211:05:322
56407699200,19cyclictest0-21swapper/211:05:322
56407699200,19cyclictest0-21swapper/210:09:352
56407699200,19cyclictest0-21swapper/210:09:352
56407699200,19cyclictest0-21swapper/209:56:302
56407699200,19cyclictest0-21swapper/209:26:222
56407699200,19cyclictest0-21swapper/209:01:492
56407699200,19cyclictest0-21swapper/208:18:152
56407699200,19cyclictest0-21swapper/208:11:332
56407699200,19cyclictest0-21swapper/207:41:042
56407699200,19cyclictest0-21swapper/207:27:262
564068992018,1cyclictest3056-21PK-Backend10:38:551
564068992018,1cyclictest3056-21PK-Backend07:14:001
564068992018,1cyclictest0-21swapper/112:38:181
564068992018,1cyclictest0-21swapper/111:14:501
564068992018,1cyclictest0-21swapper/110:25:301
564068992018,1cyclictest0-21swapper/108:43:091
564068992018,1cyclictest0-21swapper/107:15:081
564068992016,2cyclictest593524-21memory08:30:171
56406899200,1cyclictest0-21swapper/111:50:061
56406899200,1cyclictest0-21swapper/111:21:541
56406899200,19cyclictest3056-21PK-Backend10:47:391
56406899200,19cyclictest3056-21PK-Backend07:33:541
56406899200,19cyclictest0-21swapper/111:09:101
56406899200,19cyclictest0-21swapper/111:09:101
56406899200,19cyclictest0-21swapper/111:00:111
56406899200,19cyclictest0-21swapper/108:47:151
56406899200,18cyclictest3056-21PK-Backend11:26:471
56406299205,13cyclictest657878-21awk11:35:000
564062992018,1cyclictest0-21swapper/011:10:300
564062992018,1cyclictest0-21swapper/011:03:270
564062992018,1cyclictest0-21swapper/010:55:490
564062992018,1cyclictest0-21swapper/008:08:330
564062992018,1cyclictest0-21swapper/007:49:540
564062992017,2cyclictest0-21swapper/012:16:270
564062992017,2cyclictest0-21swapper/008:45:170
564062992013,5cyclictest628806-21strings10:10:170
564062992012,6cyclictest653670-21ntp_states11:20:190
564062992012,6cyclictest575970-21ls07:40:170
56406299200,1cyclictest0-21swapper/011:48:550
56406299200,1cyclictest0-21swapper/010:03:300
56406299200,1cyclictest0-21swapper/009:43:240
56406299200,1cyclictest0-21swapper/009:27:350
56406299200,19cyclictest3056-21PK-Backend07:12:230
56406299200,19cyclictest0-21swapper/012:07:010
56406299200,19cyclictest0-21swapper/011:36:460
56406299200,19cyclictest0-21swapper/010:50:570
56406299200,19cyclictest0-21swapper/009:56:420
56406299200,19cyclictest0-21swapper/008:52:070
56406299200,19cyclictest0-21swapper/008:31:040
139099200,14rtkit-daemon3056-21PK-Backend10:24:513
139099200,14rtkit-daemon0-21swapper/309:30:343
139099200,14rtkit-daemon0-21swapper/008:23:330
139099200,13rtkit-daemon0-21swapper/210:56:502
139099200,13rtkit-daemon0-21swapper/209:36:212
139099200,13rtkit-daemon0-21swapper/007:35:410
56408199192,15cyclictest0-21swapper/312:05:143
564081991917,1cyclictest3056-21PK-Backend11:19:203
564081991917,1cyclictest0-21swapper/310:48:383
564081991914,3cyclictest564382-21find07:10:103
564081991911,6cyclictest591813-21python308:25:213
564081991911,6cyclictest590287-21users08:20:223
564081991910,7cyclictest603349-21cron09:00:003
56408199190,1cyclictest3056-21PK-Backend12:33:223
56408199190,1cyclictest3056-21PK-Backend11:50:423
56408199190,1cyclictest0-21swapper/309:51:403
564076991917,1cyclictest0-21swapper/212:36:102
564076991917,1cyclictest0-21swapper/212:31:032
564076991917,1cyclictest0-21swapper/211:46:352
564076991917,1cyclictest0-21swapper/211:37:092
564076991917,1cyclictest0-21swapper/210:30:172
564076991917,1cyclictest0-21swapper/207:30:102
564076991912,5cyclictest602558-21netstat08:55:172
564076991911,6cyclictest578819-21dpkg07:50:102
56407699190,18cyclictest0-21swapper/207:59:432
564068991917,1cyclictest3056-21PK-Backend10:02:321
564068991917,1cyclictest3056-21PK-Backend08:52:421
564068991913,4cyclictest1095-21runrttasks10:15:211
56406899190,1cyclictest3056-21PK-Backend12:11:151
56406899190,1cyclictest3056-21PK-Backend10:40:171
56406899190,1cyclictest3056-21PK-Backend07:47:331
56406899190,1cyclictest0-21swapper/112:21:021
56406899190,1cyclictest0-21swapper/111:41:281
56406899190,18cyclictest0-21swapper/108:06:191
564062991917,1cyclictest0-21swapper/012:27:160
564062991917,1cyclictest0-21swapper/011:43:150
564062991917,1cyclictest0-21swapper/011:28:080
564062991917,1cyclictest0-21swapper/011:18:540
564062991917,1cyclictest0-21swapper/010:30:490
564062991917,1cyclictest0-21swapper/010:25:210
564062991917,1cyclictest0-21swapper/008:11:310
564062991917,1cyclictest0-21swapper/007:26:080
564062991917,1cyclictest0-21swapper/007:24:470
564062991912,5cyclictest677461-21cstates12:30:130
564062991912,5cyclictest579225-21basename07:50:150
564062991911,6cyclictest609251-21cat09:15:130
564062991911,6cyclictest596389-21seq08:40:050
56406299191,13cyclictest1788620-21WebKitWebProces09:10:120
56406299190,1cyclictest0-21swapper/010:07:370
56406299190,1cyclictest0-21swapper/010:07:370
56406299190,1cyclictest0-21swapper/009:34:240
56406299190,1cyclictest0-21swapper/008:37:060
56406299190,1cyclictest0-21swapper/007:57:450
56406299190,1cyclictest0-21swapper/007:31:220
56406299190,18cyclictest0-21swapper/012:38:040
56406299190,18cyclictest0-21swapper/011:57:350
56406299190,18cyclictest0-21swapper/009:06:130
56406299190,18cyclictest0-21swapper/009:06:130
139099190,13rtkit-daemon0-21swapper/311:05:013
139099190,13rtkit-daemon0-21swapper/311:05:013
56408199189,7cyclictest667540-21ntp_states12:00:193
564081991816,1cyclictest3056-21PK-Backend07:53:513
56408199181,2cyclictest672744-21ntp_states12:15:233
564076991816,1cyclictest0-21swapper/210:49:502
564076991816,1cyclictest0-21swapper/209:08:182
564076991816,1cyclictest0-21swapper/209:08:182
564076991816,1cyclictest0-21swapper/207:46:452
564068991815,2cyclictest3056-21PK-Backend07:21:581
56406899180,17cyclictest3056-21PK-Backend09:16:011
564062991816,1cyclictest0-21swapper/011:05:370
564062991816,1cyclictest0-21swapper/011:05:370
564062991816,1cyclictest0-21swapper/009:23:300
564062991816,1cyclictest0-21swapper/009:02:410
564062991814,3cyclictest568090-21dump-pmu-power07:20:010
56406299180,1cyclictest0-21swapper/010:46:030
56406299180,1cyclictest0-21swapper/010:15:480
56406299180,1cyclictest0-21swapper/009:54:320
564081991715,1cyclictest3056-21PK-Backend09:06:383
564081991715,1cyclictest3056-21PK-Backend09:06:383
564081991714,2cyclictest3056-21PK-Backend11:47:123
564081991711,5cyclictest585508-21systemctl08:10:003
564076991715,1cyclictest3056-21PK-Backend10:10:232
564068991715,1cyclictest3056-21PK-Backend09:31:021
564068991715,1cyclictest0-21swapper/109:13:511
56406899170,16cyclictest3056-21PK-Backend09:26:561
564062991715,1cyclictest0-21swapper/010:21:160
564062991713,3cyclictest638533-21sh10:40:000
564062991711,5cyclictest671174-21grep12:10:200
564062991711,4cyclictest639537-21cat10:40:200
564062991710,6cyclictest617202-21cron09:40:000
564081991611,3cyclictest636406-21users10:30:223
56407699169,5cyclictest566540-21cat07:15:032
56407699165,2cyclictest141rcu_preempt08:45:122
564076991614,1cyclictest0-21swapper/211:02:012
56406899168,6cyclictest666535-21cron12:00:001
564068991614,1cyclictest3056-21PK-Backend12:06:221
564062991612,2cyclictest675204-21turbostat12:25:000
564062991610,5cyclictest601939-21cat08:55:110
564068991512,2cyclictest587457-21/usr/sbin/munin08:15:181
56406299158,5cyclictest582427-21expr08:00:110
56406299158,5cyclictest582427-21expr08:00:110
564062991513,1cyclictest3056-21PK-Backend12:00:320
564076991311,1cyclictest0-21swapper/210:26:112
56406899139,3cyclictest3056-21PK-Backend12:19:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional