You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 21:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackcslot7s.osadl.org (updated Sat Jul 25, 2026 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
173042421420,3sleep30-21swapper/308:30:003
172557521260,4sleep03056-21PK-Backend08:15:140
17002672990,10sleep00-21swapper/007:05:160
169970827839,9sleep20-21swapper/207:05:012
170104426445,13sleep10-21swapper/107:06:061
170104626341,14sleep30-21swapper/307:06:083
18029322510,4sleep30-21swapper/311:55:193
17521722490,2sleep30-21swapper/309:30:203
18132932480,4sleep30-21swapper/312:25:143
18112052320,8sleep013-21ksoftirqd/012:20:140
139099260,17rtkit-daemon0-21swapper/310:00:123
1701523992417,5cyclictest1771319-21grep10:25:183
1701517992420,3cyclictest1716495-21df_inode07:50:131
170152399238,13cyclictest1726299-21timerandwakeup08:15:233
170151999238,4cyclictest436-20systemd-journal11:50:012
1701519992316,5cyclictest1776242-21df10:40:142
1701514992321,1cyclictest0-21swapper/011:49:190
170152399225,6cyclictest1810870-21sshd12:19:283
170152399222,18cyclictest1746981-21python309:15:213
170152399220,21cyclictest3056-21PK-Backend11:32:443
170152399220,20cyclictest3056-21PK-Backend11:48:063
170152399220,20cyclictest3056-21PK-Backend11:40:023
1701519992220,1cyclictest0-21swapper/211:42:032
1701519992220,1cyclictest0-21swapper/209:29:552
1701519992211,9cyclictest1760017-21unin-run09:55:002
170151999220,20cyclictest0-21swapper/207:24:442
1701517992220,1cyclictest3056-21PK-Backend09:14:291
1701517992219,2cyclictest3056-21PK-Backend09:49:311
1701514992220,1cyclictest0-21swapper/012:03:510
1701514992220,1cyclictest0-21swapper/010:29:280
1701514992220,1cyclictest0-21swapper/009:16:410
1701514992220,1cyclictest0-21swapper/008:39:110
1701514992220,1cyclictest0-21swapper/007:50:430
1701514992220,1cyclictest0-21swapper/007:38:200
1701514992220,1cyclictest0-21swapper/007:26:160
170151499220,3cyclictest1706532-21grep07:20:210
1701523992119,1cyclictest0-21swapper/312:14:163
1701523992119,1cyclictest0-21swapper/311:03:383
1701523992119,1cyclictest0-21swapper/310:40:133
1701523992119,1cyclictest0-21swapper/309:46:453
1701523992119,1cyclictest0-21swapper/308:23:453
170152399211,7cyclictest1811201-21apt12:20:133
170152399210,2cyclictest0-21swapper/310:50:233
170152399210,19cyclictest3056-21PK-Backend11:50:163
170152399210,19cyclictest0-21swapper/307:35:113
1701519992119,1cyclictest0-21swapper/212:23:552
1701519992119,1cyclictest0-21swapper/212:09:412
1701519992119,1cyclictest0-21swapper/212:00:492
1701519992119,1cyclictest0-21swapper/211:03:502
1701519992119,1cyclictest0-21swapper/208:58:122
1701519992119,1cyclictest0-21swapper/208:45:212
1701519992119,1cyclictest0-21swapper/208:31:282
1701519992119,1cyclictest0-21swapper/208:20:472
1701519992119,1cyclictest0-21swapper/208:03:032
1701519992119,1cyclictest0-21swapper/207:51:472
1701519992119,1cyclictest0-21swapper/207:40:452
1701519992119,1cyclictest0-21swapper/207:13:542
1701519992115,4cyclictest1714568-21cut07:45:142
170151999210,20cyclictest0-21swapper/212:36:452
170151999210,20cyclictest0-21swapper/212:10:292
170151999210,20cyclictest0-21swapper/210:07:272
170151999210,20cyclictest0-21swapper/209:22:192
170151999210,20cyclictest0-21swapper/209:22:182
170151999210,19cyclictest0-21swapper/207:16:052
1701517992119,1cyclictest3056-21PK-Backend12:21:391
1701517992119,1cyclictest3056-21PK-Backend11:53:551
1701517992119,1cyclictest3056-21PK-Backend09:57:551
1701517992119,1cyclictest3056-21PK-Backend08:59:151
1701517992119,1cyclictest3056-21PK-Backend08:41:371
1701517992119,1cyclictest3056-21PK-Backend08:30:361
1701517992119,1cyclictest3056-21PK-Backend08:14:541
1701517992119,1cyclictest3056-21PK-Backend07:31:551
1701517992119,1cyclictest3056-21PK-Backend07:20:531
1701517992119,1cyclictest0-21swapper/111:33:001
1701517992119,1cyclictest0-21swapper/107:14:241
1701517992118,2cyclictest3056-21PK-Backend10:02:091
170151799210,20cyclictest3056-21PK-Backend09:02:401
170151799210,19cyclictest3056-21PK-Backend12:38:361
170151799210,19cyclictest3056-21PK-Backend12:32:421
170151799210,19cyclictest3056-21PK-Backend10:14:531
1701514992119,1cyclictest0-21swapper/011:44:460
1701514992119,1cyclictest0-21swapper/011:18:290
1701514992119,1cyclictest0-21swapper/011:12:350
1701514992119,1cyclictest0-21swapper/010:24:410
1701514992119,1cyclictest0-21swapper/010:17:330
1701514992119,1cyclictest0-21swapper/009:58:470
1701514992119,1cyclictest0-21swapper/009:43:320
1701514992119,1cyclictest0-21swapper/009:12:300
1701514992119,1cyclictest0-21swapper/008:27:060
1701514992119,1cyclictest0-21swapper/007:18:130
1701514992114,6cyclictest883-21dbus-daemon12:40:010
170151499210,20cyclictest0-21swapper/011:02:060
170151499210,20cyclictest0-21swapper/009:05:400
170151499210,20cyclictest0-21swapper/008:34:580
170151499210,20cyclictest0-21swapper/008:13:010
170151499210,1cyclictest0-21swapper/012:33:250
139099210,14rtkit-daemon0-21swapper/211:13:122
170152399205,3cyclictest917-21in:imuxsock07:45:003
1701523992018,1cyclictest0-21swapper/312:32:473
1701523992018,1cyclictest0-21swapper/310:20:333
1701523992018,1cyclictest0-21swapper/309:50:593
1701523992018,1cyclictest0-21swapper/308:33:243
1701523992018,1cyclictest0-21swapper/308:09:523
1701523992018,1cyclictest0-21swapper/307:34:233
1701523992015,3cyclictest1733121-21python308:35:233
1701523992013,5cyclictest42-21ksoftirqd/309:05:213
1701523992011,7cyclictest1806107-21df12:05:163
170152399200,19cyclictest3056-21PK-Backend11:05:523
170152399200,19cyclictest0-21swapper/310:56:553
170152399200,19cyclictest0-21swapper/310:35:253
170152399200,19cyclictest0-21swapper/309:42:333
170152399200,19cyclictest0-21swapper/309:39:083
170152399200,19cyclictest0-21swapper/308:55:283
170152399200,19cyclictest0-21swapper/308:41:033
170152399200,19cyclictest0-21swapper/307:17:073
170151999209,9cyclictest1735485-21unin-run08:45:002
1701519992018,1cyclictest3056-21PK-Backend11:15:212
1701519992018,1cyclictest3056-21PK-Backend11:08:232
1701519992018,1cyclictest0-21swapper/211:33:312
1701519992018,1cyclictest0-21swapper/209:46:102
1701519992018,1cyclictest0-21swapper/209:43:342
1701519992018,1cyclictest0-21swapper/209:18:542
1701519992018,1cyclictest0-21swapper/209:03:252
1701519992017,2cyclictest3056-21PK-Backend11:35:072
1701519992013,5cyclictest436-20systemd-journal08:35:282
1701519992011,7cyclictest1752829-21http09:32:222
170151999200,1cyclictest0-21swapper/210:31:462
170151999200,1cyclictest0-21swapper/209:06:022
170151999200,1cyclictest0-21swapper/207:25:312
170151999200,19cyclictest0-21swapper/211:57:052
170151999200,19cyclictest0-21swapper/211:54:072
170151999200,19cyclictest0-21swapper/211:27:242
170151999200,19cyclictest0-21swapper/210:16:252
170151999200,19cyclictest0-21swapper/209:59:022
170151999200,19cyclictest0-21swapper/209:36:452
170151999200,19cyclictest0-21swapper/208:27:502
170151999200,19cyclictest0-21swapper/208:08:162
170151999200,19cyclictest0-21swapper/207:38:212
1701517992018,1cyclictest3056-21PK-Backend08:50:021
1701517992018,1cyclictest3056-21PK-Backend08:36:381
1701517992018,1cyclictest3056-21PK-Backend08:25:221
1701517992018,1cyclictest0-21swapper/111:26:181
1701517992018,1cyclictest0-21swapper/111:18:461
1701517992018,1cyclictest0-21swapper/107:58:391
1701517992017,2cyclictest3056-21PK-Backend09:09:291
1701517992017,2cyclictest0-21swapper/107:25:131
1701517992012,6cyclictest883-21dbus-daemon10:34:551
1701517992011,7cyclictest1703733-21df07:15:021
170151799200,19cyclictest3056-21PK-Backend08:17:301
170151799200,19cyclictest0-21swapper/111:45:501
170151799200,19cyclictest0-21swapper/111:41:171
170151799200,19cyclictest0-21swapper/111:05:211
170151799200,19cyclictest0-21swapper/110:08:311
170151799200,19cyclictest0-21swapper/108:02:511
170151799200,18cyclictest3056-21PK-Backend12:26:471
1701514992018,1cyclictest0-21swapper/012:12:440
1701514992018,1cyclictest0-21swapper/011:50:050
1701514992018,1cyclictest0-21swapper/011:36:280
1701514992018,1cyclictest0-21swapper/011:25:110
1701514992018,1cyclictest0-21swapper/009:46:570
1701514992018,1cyclictest0-21swapper/009:25:070
1701514992018,1cyclictest0-21swapper/008:52:480
1701514992018,1cyclictest0-21swapper/008:45:120
1701514992018,1cyclictest0-21swapper/007:42:190
1701514992014,5cyclictest883-21dbus-daemon07:48:030
1701514992014,5cyclictest1759973-21cron09:55:010
170151499200,1cyclictest0-21swapper/011:05:520
170151499200,1cyclictest0-21swapper/009:22:300
170151499200,1cyclictest0-21swapper/009:22:290
170151499200,19cyclictest0-21swapper/012:17:500
170151499200,19cyclictest0-21swapper/011:31:540
170151499200,19cyclictest0-21swapper/010:33:270
170151499200,19cyclictest0-21swapper/009:03:040
170151499200,19cyclictest0-21swapper/008:20:040
170151499200,19cyclictest0-21swapper/008:07:480
170151499200,19cyclictest0-21swapper/008:01:450
170151499200,19cyclictest0-21swapper/007:11:100
139099200,14rtkit-daemon3056-21PK-Backend11:21:543
139099200,14rtkit-daemon3056-21PK-Backend07:58:553
139099200,14rtkit-daemon0-21swapper/308:13:523
1701523991917,1cyclictest3056-21PK-Backend10:33:503
1701523991917,1cyclictest0-21swapper/312:36:323
1701523991917,1cyclictest0-21swapper/309:59:243
1701523991917,1cyclictest0-21swapper/309:29:093
1701523991916,2cyclictest3056-21PK-Backend07:14:233
1701523991914,4cyclictest1717575-21cron07:55:013
170152399190,1cyclictest3056-21PK-Backend11:29:473
170152399190,18cyclictest3056-21PK-Backend11:18:123
170152399190,18cyclictest0-21swapper/309:02:173
170152399190,18cyclictest0-21swapper/308:52:523
1701519991917,1cyclictest3056-21PK-Backend09:10:292
1701519991917,1cyclictest3056-21PK-Backend07:30:042
1701519991917,1cyclictest0-21swapper/210:56:212
1701519991915,2cyclictest2085813-21snapd11:23:442
170151999190,1cyclictest0-21swapper/212:27:392
170151999190,1cyclictest0-21swapper/208:17:082
1701517991917,1cyclictest3056-21PK-Backend12:01:121
1701517991917,1cyclictest3056-21PK-Backend10:55:421
1701517991917,1cyclictest0-21swapper/111:37:331
1701517991917,1cyclictest0-21swapper/111:22:311
1701517991916,2cyclictest3056-21PK-Backend09:44:311
170151799191,1cyclictest141rcu_preempt10:19:591
170151799190,1cyclictest3056-21PK-Backend12:15:451
170151799190,1cyclictest3056-21PK-Backend12:12:471
170151799190,1cyclictest3056-21PK-Backend11:58:141
170151799190,1cyclictest3056-21PK-Backend08:46:371
1701514991917,1cyclictest0-21swapper/009:39:190
1701514991917,1cyclictest0-21swapper/008:59:380
1701514991917,1cyclictest0-21swapper/007:30:010
1701514991912,5cyclictest1805949-21expr12:05:160
1701514991912,5cyclictest1763647-21date10:05:010
170151499190,1cyclictest0-21swapper/010:50:230
170151499190,1cyclictest0-21swapper/009:30:070
170151499190,18cyclictest0-21swapper/011:21:260
170152399183,3cyclictest1766072-21missed_timers10:10:193
1701523991816,1cyclictest3056-21PK-Backend08:04:523
1701523991816,1cyclictest0-21swapper/310:45:473
1701523991815,2cyclictest3056-21PK-Backend11:12:313
1701523991813,4cyclictest42-21ksoftirqd/312:00:193
1701523991813,3cyclictest1764306-21memory10:05:193
1701523991813,3cyclictest1735930-21cstates08:45:133
170152399181,15cyclictest1705649-21apt07:20:123
170152399180,17cyclictest3056-21PK-Backend11:39:243
1701519991814,3cyclictest978-21snmpd10:37:492
1701519991812,4cyclictest1816159-21idleruntime-cro12:35:002
1701519991811,5cyclictest1766426-21sed10:10:232
170151999181,12cyclictest1809462-21apt12:15:122
1701519991810,6cyclictest1770678-21grep10:25:142
1701517991817,1cyclictest0-21swapper/111:12:511
1701517991811,5cyclictest1722925-21sshd08:08:281
170151799180,1cyclictest3056-21PK-Backend12:05:311
1701514991816,1cyclictest0-21swapper/008:41:480
1701514991812,5cyclictest1803797-21grep12:00:010
1701514991810,6cyclictest2175-21JS10:27:480
17703822170,3sleep11770400-21turbostat10:24:591
170152399179,6cyclictest1715086-21ntp_kernel_err07:45:203
170152399170,6cyclictest1745633-21taskset09:12:263
170152399170,15cyclictest1767191-21apt10:15:123
170152399170,15cyclictest1748228-21diskstats09:20:153
170152399170,15cyclictest1748228-21diskstats09:20:143
1701519991715,1cyclictest0-21swapper/210:49:442
1701519991715,1cyclictest0-21swapper/210:00:042
1701519991715,1cyclictest0-21swapper/208:51:232
1701517991715,1cyclictest3056-21PK-Backend11:02:251
1701517991715,1cyclictest3056-21PK-Backend10:50:071
1701517991715,1cyclictest3056-21PK-Backend09:19:291
1701517991711,5cyclictest883-21dbus-daemon09:35:001
1701517991710,5cyclictest2173-21JS10:27:481
1701514991715,1cyclictest0-21swapper/010:47:130
1701514991711,4cyclictest1814421-21munin-run12:29:590
1701514991711,4cyclictest1766260-21cut10:10:220
1701514991710,5cyclictest1774286-21tr10:35:150
170152399168,6cyclictest42-21ksoftirqd/307:25:123
170151999169,5cyclictest1723634-21cat08:10:142
1701519991614,1cyclictest0-21swapper/207:57:012
1701519991610,4cyclictest1768655-21cron10:20:012
1701517991614,1cyclictest3056-21PK-Backend09:53:431
1701517991614,1cyclictest3056-21PK-Backend08:22:441
1701517991614,1cyclictest3056-21PK-Backend07:45:131
1701517991614,1cyclictest3056-21PK-Backend07:37:161
1701514991612,3cyclictest1777353-21/usr/sbin/munin10:45:010
170151999159,4cyclictest1779459-21cpuspeed_turbos10:50:172
1701517991513,1cyclictest3056-21PK-Backend09:24:301
1701517991513,1cyclictest3056-21PK-Backend09:24:301
1701517991512,2cyclictest3056-21PK-Backend09:39:301
1701514991511,3cyclictest1782093-21timerwakeupswit10:55:220
1701517991412,1cyclictest3056-21PK-Backend09:29:291
1701517991410,2cyclictest1772133-21latency_hist10:30:011
170151499149,3cyclictest1764640-21wc10:05:240
170151799135,6cyclictest1777344-21cron10:45:001
170151799133,2cyclictest141rcu_preempt07:40:231
170151799128,3cyclictest3056-21PK-Backend10:48:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional