You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 22:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Fri May 22, 2026 12:44:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
317166527845,22sleep10-21swapper/107:05:121
317280527739,32sleep30-21swapper/307:05:473
317294226950,13sleep00-21swapper/007:07:330
317289226244,13sleep20-21swapper/207:06:542
32067492580,4sleep00-21swapper/008:45:010
32484812510,2sleep00-21swapper/010:40:000
32038872450,3sleep00-21swapper/008:35:140
32753962420,3sleep10-21swapper/111:55:161
31952492270,10sleep013-21ksoftirqd/008:10:160
3173293992715,10cyclictest3199814-21unin-run08:24:593
3173278992515,8cyclictest883-21dbus-daemon11:58:060
32624132240,4sleep20-21swapper/211:20:012
317329399241,20cyclictest3193116-21apt08:05:143
317328499242,3cyclictest3208467-21latency_hist08:50:001
3173293992321,1cyclictest0-21swapper/310:29:333
3173293992320,1cyclictest3056-21PK-Backend12:10:053
3173293992315,5cyclictest3283640-21apt12:20:103
3173278992313,8cyclictest3213654-21apt-get09:05:000
3173278992313,8cyclictest3213654-21apt-get09:05:000
139099230,16rtkit-daemon3056-21PK-Backend11:11:443
3173293992220,1cyclictest3056-21PK-Backend12:04:023
3173293992220,1cyclictest3056-21PK-Backend12:04:023
3173293992220,1cyclictest0-21swapper/307:20:263
317329399220,20cyclictest3056-21PK-Backend08:26:163
317328899223,17cyclictest3194581-21perf08:09:592
3173288992220,1cyclictest0-21swapper/210:35:262
3173288992220,1cyclictest0-21swapper/207:58:102
3173288992214,6cyclictest436-20systemd-journal10:32:082
3173288992214,6cyclictest3213646-21cron09:04:592
3173288992214,6cyclictest3213646-21cron09:04:592
317328899220,20cyclictest3194859-21apt08:10:132
317328499222,18cyclictest3270960-21sh11:45:001
317328499220,20cyclictest3056-21PK-Backend11:34:551
317328499220,20cyclictest3056-21PK-Backend08:14:251
3173278992214,6cyclictest3278168-21/usr/sbin/munin12:05:000
3173278992214,6cyclictest3278168-21/usr/sbin/munin12:04:590
3173278992211,9cyclictest3251914-21unin-run10:50:010
3173278992211,7cyclictest2361-21gdbus11:41:310
139099220,15rtkit-daemon0-21swapper/308:14:213
3173293992119,1cyclictest3056-21PK-Backend11:23:343
3173293992119,1cyclictest0-21swapper/312:38:583
3173293992119,1cyclictest0-21swapper/312:07:283
3173293992119,1cyclictest0-21swapper/311:27:463
3173293992119,1cyclictest0-21swapper/310:31:213
3173293992119,1cyclictest0-21swapper/310:11:273
3173293992119,1cyclictest0-21swapper/310:08:523
3173293992119,1cyclictest0-21swapper/310:08:513
3173293992119,1cyclictest0-21swapper/309:30:393
3173293992119,1cyclictest0-21swapper/307:28:573
3173293992119,1cyclictest0-21swapper/307:10:333
3173293992119,1cyclictest0-21swapper/307:10:333
3173293992118,2cyclictest3056-21PK-Backend11:59:503
3173293992118,2cyclictest3056-21PK-Backend11:42:133
3173293992113,6cyclictest883-21dbus-daemon12:26:323
3173293992112,7cyclictest3222767-21python309:25:203
317329399210,20cyclictest3056-21PK-Backend11:39:353
317329399210,20cyclictest0-21swapper/310:40:003
317329399210,20cyclictest0-21swapper/310:23:323
317329399210,20cyclictest0-21swapper/308:00:563
317329399210,19cyclictest3056-21PK-Backend10:46:503
317329399210,19cyclictest3056-21PK-Backend09:07:543
3173288992119,1cyclictest0-21swapper/212:37:392
3173288992119,1cyclictest0-21swapper/212:30:502
3173288992119,1cyclictest0-21swapper/212:19:362
3173288992119,1cyclictest0-21swapper/212:10:562
3173288992119,1cyclictest0-21swapper/211:27:442
3173288992119,1cyclictest0-21swapper/209:58:342
3173288992119,1cyclictest0-21swapper/209:13:062
3173288992119,1cyclictest0-21swapper/208:20:542
3173288992119,1cyclictest0-21swapper/207:33:282
3173288992116,3cyclictest3269213-21cron11:40:002
3173288992113,6cyclictest3219384-21apt-get09:20:012
317328899210,20cyclictest3056-21PK-Backend10:56:212
317328899210,20cyclictest0-21swapper/212:09:072
317328899210,20cyclictest0-21swapper/211:46:362
317328899210,20cyclictest0-21swapper/211:43:592
317328899210,20cyclictest0-21swapper/211:20:552
317328899210,20cyclictest0-21swapper/209:35:032
3173284992115,5cyclictest3271388-21mktemp11:45:011
317328499210,20cyclictest3251212-21ps10:45:201
317328499210,1cyclictest3056-21PK-Backend10:09:241
317328499210,1cyclictest3056-21PK-Backend10:09:231
317328499210,19cyclictest3056-21PK-Backend10:16:131
317328499210,19cyclictest3056-21PK-Backend10:12:481
317328499210,19cyclictest3056-21PK-Backend09:47:541
317328499210,19cyclictest3056-21PK-Backend09:27:261
317328499210,19cyclictest3056-21PK-Backend07:49:251
3173278992119,1cyclictest0-21swapper/008:31:240
3173278992118,2cyclictest0-21swapper/007:42:300
3173278992114,6cyclictest3289835-21awk12:35:190
3173278992113,6cyclictest3263425-21awk11:20:200
3173278992111,8cyclictest883-21dbus-daemon09:00:000
317327899210,20cyclictest0-21swapper/011:19:560
317327899210,20cyclictest0-21swapper/009:25:050
317327899210,20cyclictest0-21swapper/007:54:390
317327899210,19cyclictest0-21swapper/010:40:070
317329399205,13cyclictest436-20systemd-journal10:20:013
3173293992018,1cyclictest3056-21PK-Backend11:46:263
3173293992018,1cyclictest3056-21PK-Backend11:18:343
3173293992018,1cyclictest0-21swapper/311:30:233
3173293992018,1cyclictest0-21swapper/309:46:063
3173293992018,1cyclictest0-21swapper/307:57:303
3173293992018,1cyclictest0-21swapper/307:34:533
3173293992013,5cyclictest3221541-21date09:25:003
3173293992012,6cyclictest436-20systemd-journal09:15:003
3173293992012,6cyclictest3188198-21cat07:50:123
317329399200,1cyclictest3056-21PK-Backend08:59:293
317329399200,1cyclictest0-21swapper/307:37:573
317329399200,19cyclictest3056-21PK-Backend08:41:593
317329399200,19cyclictest0-21swapper/309:44:173
317329399200,19cyclictest0-21swapper/309:38:163
317329399200,19cyclictest0-21swapper/309:19:573
317329399200,19cyclictest0-21swapper/307:19:243
317329399200,18cyclictest3056-21PK-Backend10:50:153
3173288992018,1cyclictest0-21swapper/211:14:522
3173288992018,1cyclictest0-21swapper/211:00:472
3173288992018,1cyclictest0-21swapper/209:31:372
3173288992018,1cyclictest0-21swapper/208:56:502
3173288992018,1cyclictest0-21swapper/208:17:162
3173288992018,1cyclictest0-21swapper/207:27:332
3173288992015,3cyclictest3257681-21cstates11:05:132
3173288992015,3cyclictest3257681-21cstates11:05:122
3173288992014,5cyclictest3235840-21sed10:00:202
3173288992012,6cyclictest883-21dbus-daemon12:21:332
317328899200,1cyclictest0-21swapper/210:44:032
317328899200,1cyclictest0-21swapper/209:25:222
317328899200,19cyclictest0-21swapper/210:54:312
317328899200,19cyclictest0-21swapper/210:15:172
317328899200,19cyclictest0-21swapper/209:46:182
317328899200,19cyclictest0-21swapper/209:41:042
317328899200,19cyclictest0-21swapper/208:04:582
317328899200,19cyclictest0-21swapper/207:35:322
3173284992018,1cyclictest0-21swapper/111:39:071
3173284992018,1cyclictest0-21swapper/111:13:051
3173284992018,1cyclictest0-21swapper/110:42:431
3173284992017,2cyclictest3056-21PK-Backend08:19:381
3173284992015,4cyclictest26-21ksoftirqd/108:55:111
317328499200,1cyclictest3056-21PK-Backend10:51:201
317328499200,19cyclictest3056-21PK-Backend09:37:391
317328499200,19cyclictest0-21swapper/108:33:111
317328499200,18cyclictest3056-21PK-Backend10:26:261
3173278992019,1cyclictest0-21swapper/007:23:570
3173278992018,1cyclictest0-21swapper/010:25:410
3173278992018,1cyclictest0-21swapper/008:06:160
3173278992018,1cyclictest0-21swapper/007:48:170
3173278992017,2cyclictest0-21swapper/011:45:100
3173278992014,4cyclictest13-21ksoftirqd/007:31:260
3173278992013,4cyclictest3254551-21needreboot10:55:160
3173278992011,7cyclictest3176436-21ntp_states07:15:190
317327899201,13cyclictest3213654-21apt-get09:05:040
317327899200,1cyclictest0-21swapper/009:30:180
317327899200,19cyclictest0-21swapper/012:08:500
317327899200,19cyclictest0-21swapper/011:39:090
317327899200,19cyclictest0-21swapper/011:13:060
317327899200,19cyclictest0-21swapper/011:02:380
317327899200,19cyclictest0-21swapper/010:52:110
317327899200,19cyclictest0-21swapper/009:17:130
317327899200,19cyclictest0-21swapper/008:45:360
139099200,14rtkit-daemon0-21swapper/308:17:403
31744032190,4sleep00-21swapper/007:10:210
31744032190,4sleep00-21swapper/007:10:200
317329399192,5cyclictest3203998-21chrt08:35:173
3173293991917,1cyclictest3056-21PK-Backend10:55:293
3173293991917,1cyclictest0-21swapper/312:16:543
3173293991917,1cyclictest0-21swapper/309:51:203
3173293991917,1cyclictest0-21swapper/307:44:203
3173293991914,4cyclictest42-21ksoftirqd/310:00:103
317329399190,1cyclictest3056-21PK-Backend11:05:423
317329399190,1cyclictest3056-21PK-Backend11:05:423
317329399190,1cyclictest3056-21PK-Backend08:48:553
317329399190,1cyclictest0-21swapper/309:59:123
3173288991917,1cyclictest0-21swapper/212:03:062
3173288991917,1cyclictest0-21swapper/212:03:052
3173288991917,1cyclictest0-21swapper/211:51:512
3173288991917,1cyclictest0-21swapper/211:34:342
3173288991917,1cyclictest0-21swapper/210:48:292
3173288991917,1cyclictest0-21swapper/209:50:432
3173288991917,1cyclictest0-21swapper/209:07:042
3173288991917,1cyclictest0-21swapper/207:23:422
3173288991917,1cyclictest0-21swapper/207:11:462
3173288991917,1cyclictest0-21swapper/207:11:462
3173288991911,6cyclictest3237296-21ntpq10:05:192
3173288991911,6cyclictest3237296-21ntpq10:05:192
317328899190,1cyclictest0-21swapper/210:20:312
317328899190,1cyclictest0-21swapper/208:44:402
317328899190,18cyclictest0-21swapper/209:15:432
3173284991917,1cyclictest3056-21PK-Backend10:01:461
3173284991917,1cyclictest3056-21PK-Backend09:56:331
3173284991917,1cyclictest3056-21PK-Backend08:24:061
3173284991917,1cyclictest3056-21PK-Backend07:33:361
3173284991917,1cyclictest0-21swapper/111:02:371
3173284991917,1cyclictest0-21swapper/108:36:021
3173284991912,5cyclictest3264333-21cpuspeed11:25:111
3173284991912,5cyclictest3254600-21ntpq10:55:171
3173284991912,5cyclictest3205988-21ntpq08:40:181
317328499190,1cyclictest3056-21PK-Backend09:50:311
317328499190,1cyclictest3056-21PK-Backend09:16:111
317328499190,1cyclictest3056-21PK-Backend08:06:481
317328499190,1cyclictest3056-21PK-Backend08:01:011
317328499190,1cyclictest3056-21PK-Backend07:44:371
317328499190,1cyclictest3056-21PK-Backend07:25:521
317328499190,1cyclictest3056-21PK-Backend07:17:341
317328499190,1cyclictest0-21swapper/112:05:221
317328499190,1cyclictest0-21swapper/111:20:411
317328499190,1cyclictest0-21swapper/111:15:401
317328499190,18cyclictest3056-21PK-Backend12:12:591
317328499190,18cyclictest3056-21PK-Backend10:35:531
317328499190,18cyclictest0-21swapper/111:50:081
317328499190,18cyclictest0-21swapper/111:05:141
317328499190,18cyclictest0-21swapper/111:05:141
317328499190,18cyclictest0-21swapper/109:05:551
317328499190,18cyclictest0-21swapper/108:25:551
3173278991917,2cyclictest0-21swapper/010:01:010
3173278991917,1cyclictest0-21swapper/011:33:200
3173278991917,1cyclictest0-21swapper/011:26:440
3173278991917,1cyclictest0-21swapper/010:07:500
3173278991917,1cyclictest0-21swapper/010:07:490
3173278991917,1cyclictest0-21swapper/009:10:230
3173278991917,1cyclictest0-21swapper/008:50:230
317327899190,1cyclictest0-21swapper/012:34:380
317327899190,1cyclictest0-21swapper/010:23:040
317327899190,18cyclictest0-21swapper/012:24:510
317327899190,18cyclictest0-21swapper/011:07:530
317327899190,18cyclictest0-21swapper/011:07:520
317327899190,18cyclictest0-21swapper/008:28:340
317327899190,18cyclictest0-21swapper/008:24:540
3173293991816,1cyclictest3056-21PK-Backend09:02:543
3173293991816,1cyclictest3056-21PK-Backend09:02:543
3173293991815,2cyclictest3056-21PK-Backend10:42:373
3173293991812,5cyclictest3288192-21sed12:30:203
3173288991816,1cyclictest0-21swapper/208:29:122
3173288991814,3cyclictest34-21ksoftirqd/210:28:122
3173288991813,3cyclictest3188454-21latency07:50:162
3173288991812,4cyclictest3238727-21cat10:10:142
3173288991812,4cyclictest2156-21gnome-shell07:45:092
3173288991810,6cyclictest3175222-21ls07:15:022
3173284991816,1cyclictest3056-21PK-Backend12:29:501
3173284991816,1cyclictest3056-21PK-Backend12:15:361
3173284991816,1cyclictest3056-21PK-Backend09:21:241
3173284991816,1cyclictest3056-21PK-Backend07:55:131
3173284991816,1cyclictest3056-21PK-Backend07:12:191
3173284991816,1cyclictest3056-21PK-Backend07:12:191
3173284991816,1cyclictest0-21swapper/109:01:441
3173284991816,1cyclictest0-21swapper/109:01:431
3173284991810,6cyclictest3210180-21cron08:55:011
3173278991816,1cyclictest0-21swapper/009:49:440
3173278991816,1cyclictest0-21swapper/008:19:400
3173278991811,5cyclictest3273870-21cat11:50:170
3173278991811,5cyclictest3233895-21awk09:55:220
3173278991810,6cyclictest3221368-21apt-get09:25:000
317327899180,17cyclictest0-21swapper/009:52:220
3173293991714,2cyclictest3056-21PK-Backend08:30:573
3173293991712,3cyclictest3186173-21apt07:45:123
3173288991715,1cyclictest0-21swapper/212:27:252
3173288991715,1cyclictest0-21swapper/208:35:542
3173288991715,1cyclictest0-21swapper/208:30:132
3173288991712,3cyclictest3184949-21latency07:40:162
317328899170,6cyclictest0-21swapper/208:45:132
3173284991714,2cyclictest3056-21PK-Backend09:32:391
3173284991714,2cyclictest3056-21PK-Backend07:36:391
317327899179,6cyclictest3228824-21apt-get09:45:000
3173278991715,1cyclictest0-21swapper/010:10:270
3173278991715,1cyclictest0-21swapper/007:28:380
3173293991614,1cyclictest3056-21PK-Backend11:01:303
3173293991613,2cyclictest3056-21PK-Backend11:54:513
3173293991610,4cyclictest3210205-21idleruntime-cro08:55:003
317328499169,5cyclictest3276968-21cat12:00:131
317328499169,5cyclictest3276968-21cat12:00:131
3173284991614,1cyclictest3056-21PK-Backend12:24:021
3173284991614,1cyclictest3056-21PK-Backend09:43:421
3173284991611,4cyclictest26-21ksoftirqd/109:10:101
317327899169,5cyclictest3280678-21cut12:10:170
317327899162,12cyclictest3191098-21cron08:00:000
3173278991614,1cyclictest0-21swapper/010:33:170
3173278991612,3cyclictest3192829-21cron08:05:000
3173278991611,3cyclictest3226279-21switchtime09:35:210
317328899159,5cyclictest3209430-21awk08:50:182
3173288991510,3cyclictest3275103-21tr11:55:142
3173284991513,1cyclictest3056-21PK-Backend10:22:141
3173284991513,1cyclictest3056-21PK-Backend07:20:251
317327899158,5cyclictest3240509-21uname10:15:160
3173278991513,1cyclictest0-21swapper/012:19:500
3173278991510,3cyclictest1095-21runrttasks12:25:100
317328499149,4cyclictest3056-21PK-Backend10:30:071
3173284991410,3cyclictest3056-21PK-Backend07:50:241
317328499140,5cyclictest3056-21PK-Backend12:30:201
3173278991412,1cyclictest0-21swapper/007:35:340
3173284991311,1cyclictest3056-21PK-Backend12:39:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional