You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 00:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackcslot7s.osadl.org (updated Tue May 05, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200973921090,3sleep20-21swapper/211:20:202
192281326844,15sleep00-21swapper/007:05:150
192373526641,16sleep20-21swapper/207:08:042
19546952650,3sleep33056-21PK-Backend08:35:013
192377926443,14sleep30-21swapper/307:08:373
192357526343,14sleep10-21swapper/107:05:571
20338142410,3sleep13056-21PK-Backend12:30:171
139099410,4rtkit-daemon1389-21rtkit-daemon07:25:011
19428662370,4sleep33056-21PK-Backend08:00:133
19423612350,3sleep3411rcuc/308:00:013
139099340,3rtkit-daemon1389-21rtkit-daemon11:21:461
139099280,4rtkit-daemon1389-21rtkit-daemon11:17:110
1924048992616,8cyclictest883-21dbus-daemon10:20:462
1924043992617,7cyclictest957-21gdbus08:45:441
139099250,17rtkit-daemon2000525-21if_err_enp2s010:55:163
1924043992411,11cyclictest1956270-21unin-run08:40:011
1924039992417,6cyclictest1973906-21cron09:30:000
1924050992313,6cyclictest0-21swapper/310:30:103
1924050992312,8cyclictest883-21dbus-daemon09:40:003
1924048992321,1cyclictest0-21swapper/208:10:182
1924043992316,5cyclictest1987375-21cron10:20:001
1924050992220,1cyclictest0-21swapper/310:24:013
1924050992220,1cyclictest0-21swapper/309:49:273
1924050992220,1cyclictest0-21swapper/309:10:413
1924050992219,2cyclictest0-21swapper/308:16:333
1924050992218,3cyclictest0-21swapper/311:35:203
1924050992211,8cyclictest1940028-21ntp07:50:443
1924050992211,8cyclictest1940028-21ntp07:50:433
1924048992220,1cyclictest0-21swapper/210:04:502
1924048992220,1cyclictest0-21swapper/208:41:412
1924048992220,1cyclictest0-21swapper/207:38:012
1924048992220,1cyclictest0-21swapper/207:31:322
192404899221,7cyclictest1973782-21runrttasks09:28:302
192404899220,20cyclictest2014329-21hddtemp_smartct11:35:142
1924043992220,1cyclictest0-21swapper/112:21:401
1924043992217,3cyclictest20357592chrt12:35:181
192404399220,20cyclictest3056-21PK-Backend09:50:521
192404399220,20cyclictest3056-21PK-Backend07:17:221
192404399220,20cyclictest19578412sleep108:43:341
1924039992220,1cyclictest0-21swapper/012:19:050
1924039992220,1cyclictest0-21swapper/011:57:570
1924039992220,1cyclictest0-21swapper/010:33:000
1924039992220,1cyclictest0-21swapper/009:40:150
1924039992220,1cyclictest0-21swapper/008:31:260
1924039992220,1cyclictest0-21swapper/008:04:560
1924039992214,6cyclictest436-20systemd-journal07:34:140
1924039992211,9cyclictest2018906-21unin-run11:49:590
192403999220,21cyclictest0-21swapper/010:44:570
192403999220,21cyclictest0-21swapper/008:26:120
192403999220,21cyclictest0-21swapper/007:47:260
139099220,14rtkit-daemon0-21swapper/309:05:203
192405099219,9cyclictest1-21systemd09:25:013
1924050992119,1cyclictest3056-21PK-Backend08:36:263
1924050992119,1cyclictest0-21swapper/311:57:573
1924050992119,1cyclictest0-21swapper/310:46:183
1924050992119,1cyclictest0-21swapper/310:40:513
1924050992119,1cyclictest0-21swapper/310:26:513
1924050992119,1cyclictest0-21swapper/310:05:363
1924050992119,1cyclictest0-21swapper/307:41:313
1924050992114,4cyclictest2033341-21cpuspeed12:30:133
192405099210,20cyclictest3056-21PK-Backend12:18:183
192405099210,20cyclictest3056-21PK-Backend07:28:343
192405099210,20cyclictest0-21swapper/309:32:023
192405099210,19cyclictest3056-21PK-Backend12:20:553
192405099210,19cyclictest0-21swapper/310:19:223
192405099210,19cyclictest0-21swapper/309:53:533
1924048992119,1cyclictest0-21swapper/212:25:082
1924048992119,1cyclictest0-21swapper/212:19:422
1924048992119,1cyclictest0-21swapper/212:02:442
1924048992119,1cyclictest0-21swapper/211:18:242
1924048992119,1cyclictest0-21swapper/211:01:332
1924048992119,1cyclictest0-21swapper/210:58:432
1924048992119,1cyclictest0-21swapper/210:42:072
1924048992119,1cyclictest0-21swapper/209:46:032
1924048992119,1cyclictest0-21swapper/208:17:552
1924048992119,1cyclictest0-21swapper/207:56:332
1924048992119,1cyclictest0-21swapper/207:27:542
1924048992118,2cyclictest3056-21PK-Backend07:18:402
1924048992118,2cyclictest0-21swapper/209:14:052
1924048992115,4cyclictest2034330-21sed12:30:222
192404899210,20cyclictest1961480-21idleruntime-cro08:55:002
192404899210,20cyclictest0-21swapper/210:37:272
192404899210,20cyclictest0-21swapper/210:34:362
192404899210,20cyclictest0-21swapper/208:20:332
1924043992119,1cyclictest0-21swapper/112:16:261
1924043992118,2cyclictest3056-21PK-Backend12:26:541
192404399210,20cyclictest3056-21PK-Backend11:56:051
192404399210,19cyclictest3056-21PK-Backend11:46:111
192404399210,19cyclictest3056-21PK-Backend10:51:021
192404399210,19cyclictest3056-21PK-Backend09:17:461
192404399210,19cyclictest3056-21PK-Backend08:10:151
1924039992119,1cyclictest0-21swapper/012:31:570
1924039992119,1cyclictest0-21swapper/011:35:320
1924039992119,1cyclictest0-21swapper/011:30:060
1924039992119,1cyclictest0-21swapper/010:37:400
1924039992119,1cyclictest0-21swapper/010:16:240
1924039992119,1cyclictest0-21swapper/010:00:010
1924039992119,1cyclictest0-21swapper/009:31:080
1924039992119,1cyclictest0-21swapper/009:08:440
1924039992119,1cyclictest0-21swapper/009:02:420
1924039992119,1cyclictest0-21swapper/008:47:360
1924039992119,1cyclictest0-21swapper/008:35:530
1924039992119,1cyclictest0-21swapper/007:27:120
192403999210,20cyclictest0-21swapper/012:10:270
192403999210,20cyclictest0-21swapper/011:54:180
192403999210,20cyclictest0-21swapper/010:28:200
192403999210,20cyclictest0-21swapper/008:56:400
192403999210,20cyclictest0-21swapper/008:14:570
192403999210,20cyclictest0-21swapper/007:12:440
139099210,14rtkit-daemon0-21swapper/208:47:122
1924050992018,1cyclictest3056-21PK-Backend08:55:133
1924050992018,1cyclictest0-21swapper/312:38:133
1924050992018,1cyclictest0-21swapper/308:25:593
1924050992018,1cyclictest0-21swapper/308:08:073
1924050992017,2cyclictest3056-21PK-Backend08:47:563
1924050992015,3cyclictest978-21snmpd08:20:493
1924050992015,3cyclictest2016036-21df11:40:133
1924050992010,6cyclictest0-21swapper/311:45:113
192405099200,19cyclictest3056-21PK-Backend07:32:123
192405099200,19cyclictest0-21swapper/312:26:083
192405099200,19cyclictest0-21swapper/310:51:453
192405099200,19cyclictest0-21swapper/309:55:423
192405099200,19cyclictest0-21swapper/309:40:223
192405099200,19cyclictest0-21swapper/309:03:373
192405099200,19cyclictest0-21swapper/307:48:133
192405099200,19cyclictest0-21swapper/307:17:583
1924048992019,1cyclictest0-21swapper/212:12:392
1924048992019,1cyclictest0-21swapper/208:33:382
1924048992018,1cyclictest0-21swapper/211:50:482
1924048992018,1cyclictest0-21swapper/211:12:432
1924048992018,1cyclictest0-21swapper/210:11:172
1924048992018,1cyclictest0-21swapper/209:07:022
1924048992018,1cyclictest0-21swapper/207:23:342
1924048992018,1cyclictest0-21swapper/207:10:442
192404899201,1cyclictest0-21swapper/209:56:452
192404899201,18cyclictest0-21swapper/207:47:342
192404899200,1cyclictest0-21swapper/208:07:422
192404899200,19cyclictest3056-21PK-Backend08:35:262
192404899200,19cyclictest0-21swapper/211:08:032
192404899200,19cyclictest0-21swapper/210:49:242
192404899200,19cyclictest0-21swapper/209:02:372
192404899200,19cyclictest0-21swapper/207:53:282
192404899200,19cyclictest0-21swapper/207:53:282
1924043992018,1cyclictest0-21swapper/107:24:591
1924043992017,2cyclictest3056-21PK-Backend10:13:501
1924043992017,2cyclictest3056-21PK-Backend08:15:141
1924043992013,5cyclictest1075-21whoopsie08:50:451
1924043992011,7cyclictest883-21dbus-daemon09:20:261
192404399200,1cyclictest3056-21PK-Backend11:33:401
192404399200,1cyclictest3056-21PK-Backend07:50:001
192404399200,19cyclictest3056-21PK-Backend12:04:561
192404399200,19cyclictest3056-21PK-Backend10:01:211
192404399200,19cyclictest3056-21PK-Backend09:03:071
192404399200,19cyclictest0-21swapper/112:14:361
192404399200,19cyclictest0-21swapper/112:09:221
192404399200,19cyclictest0-21swapper/108:55:301
192404399200,19cyclictest0-21swapper/107:30:321
192404399200,18cyclictest3056-21PK-Backend11:08:111
192404399200,18cyclictest3056-21PK-Backend07:44:191
1924039992018,1cyclictest0-21swapper/012:28:330
1924039992018,1cyclictest0-21swapper/012:07:510
1924039992018,1cyclictest0-21swapper/011:11:390
1924039992018,1cyclictest0-21swapper/010:58:420
1924039992018,1cyclictest0-21swapper/010:51:250
1924039992018,1cyclictest0-21swapper/010:06:170
1924039992018,1cyclictest0-21swapper/008:09:560
1924039992018,1cyclictest0-21swapper/007:55:240
192403999200,1cyclictest0-21swapper/009:56:220
192403999200,1cyclictest0-21swapper/009:47:310
192403999200,1cyclictest0-21swapper/009:17:370
192403999200,1cyclictest0-21swapper/009:13:110
192403999200,1cyclictest0-21swapper/008:20:110
192403999200,1cyclictest0-21swapper/007:52:200
192403999200,1cyclictest0-21swapper/007:52:200
192403999200,19cyclictest0-21swapper/012:21:420
192403999200,19cyclictest0-21swapper/012:04:120
192403999200,19cyclictest0-21swapper/011:07:000
192403999200,19cyclictest0-21swapper/010:13:340
192403999200,19cyclictest0-21swapper/009:51:560
139099200,14rtkit-daemon3056-21PK-Backend12:05:012
139099200,14rtkit-daemon0-21swapper/211:47:262
139099200,14rtkit-daemon0-21swapper/211:41:552
19747662190,4chrt3056-21PK-Backend09:30:171
192405099192,16cyclictest42-21ksoftirqd/308:13:273
192405099192,13cyclictest1992868-21apt10:35:113
192405099192,12cyclictest1972454-21apt09:25:123
1924050991917,1cyclictest3056-21PK-Backend08:43:303
1924050991917,1cyclictest0-21swapper/311:26:003
1924050991917,1cyclictest0-21swapper/311:21:193
1924050991917,1cyclictest0-21swapper/311:11:123
1924050991917,1cyclictest0-21swapper/311:06:333
1924050991917,1cyclictest0-21swapper/307:11:223
1924050991916,2cyclictest0-21swapper/311:00:043
1924050991912,5cyclictest2006984-21basename11:15:093
1924050991911,6cyclictest918-21rs:main3
192405099190,1cyclictest0-21swapper/311:34:183
1924048991917,1cyclictest0-21swapper/211:25:532
1924048991917,1cyclictest0-21swapper/209:35:562
1924048991917,1cyclictest0-21swapper/208:25:472
1924048991910,7cyclictest1974930-21ntp_states09:30:202
192404899190,7cyclictest34-21ksoftirqd/212:20:272
192404899190,1cyclictest0-21swapper/212:36:252
192404899190,1cyclictest0-21swapper/210:25:182
192404899190,1cyclictest0-21swapper/209:41:232
192404899190,18cyclictest0-21swapper/209:52:192
192404899190,18cyclictest0-21swapper/209:15:552
1924043991917,1cyclictest3056-21PK-Backend10:05:471
1924043991917,1cyclictest3056-21PK-Backend09:48:151
1924043991917,1cyclictest3056-21PK-Backend09:05:441
1924043991917,1cyclictest3056-21PK-Backend08:02:501
1924043991917,1cyclictest3056-21PK-Backend07:55:541
1924043991917,1cyclictest3056-21PK-Backend07:54:531
1924043991917,1cyclictest3056-21PK-Backend07:54:531
1924043991917,1cyclictest3056-21PK-Backend07:14:041
1924043991917,1cyclictest0-21swapper/108:33:541
1924043991912,6cyclictest1934246-21python307:35:201
1924043991911,6cyclictest2008476-21cron11:20:011
192404399190,1cyclictest3056-21PK-Backend10:35:401
192404399190,1cyclictest3056-21PK-Backend10:21:071
192404399190,1cyclictest3056-21PK-Backend09:42:481
192404399190,1cyclictest3056-21PK-Backend09:36:331
192404399190,18cyclictest3056-21PK-Backend11:35:291
192404399190,18cyclictest3056-21PK-Backend11:02:441
1924039991917,1cyclictest0-21swapper/011:21:470
1924039991917,1cyclictest0-21swapper/009:21:150
1924039991911,6cyclictest1929258-21awk07:20:220
192403999190,1cyclictest0-21swapper/011:29:040
192403999190,1cyclictest0-21swapper/010:48:340
192403999190,1cyclictest0-21swapper/009:39:130
192403999190,1cyclictest0-21swapper/008:53:030
192403999190,1cyclictest0-21swapper/007:17:250
139099190,13rtkit-daemon0-21swapper/211:59:012
20161222180,4chrt13-21ksoftirqd/011:40:150
19521162180,8sleep126-21ksoftirqd/108:25:201
1924050991816,1cyclictest3056-21PK-Backend12:09:403
1924050991816,1cyclictest0-21swapper/311:54:183
1924050991816,1cyclictest0-21swapper/309:15:073
192405099181,13cyclictest978-21snmpd10:10:023
1924050991810,6cyclictest1982742-21apt-get10:04:593
1924048991816,1cyclictest0-21swapper/210:05:502
1924048991816,1cyclictest0-21swapper/208:01:402
1924048991814,2cyclictest1935256-21cpuspeed07:40:112
1924043991816,1cyclictest3056-21PK-Backend09:28:291
1924043991815,2cyclictest3056-21PK-Backend09:58:431
192404399180,1cyclictest3056-21PK-Backend10:47:231
1924039991816,1cyclictest0-21swapper/011:01:330
192403999180,1cyclictest0-21swapper/007:37:520
139099180,12rtkit-daemon3056-21PK-Backend08:54:353
19912462170,4sleep13056-21PK-Backend10:30:121
1924050991710,6cyclictest2027795-21cron12:15:003
1924048991715,1cyclictest0-21swapper/211:33:242
1924048991713,3cyclictest1986627-21ntp_offset10:15:142
192404899170,7cyclictest34-21ksoftirqd/208:57:492
1924043991715,1cyclictest3056-21PK-Backend11:41:451
1924043991715,1cyclictest3056-21PK-Backend10:42:571
1924043991715,1cyclictest3056-21PK-Backend10:28:241
1924043991714,2cyclictest0-21swapper/111:51:391
1924039991716,1cyclictest0-21swapper/012:39:340
1924039991715,1cyclictest0-21swapper/008:43:570
1924039991715,1cyclictest0-21swapper/008:16:470
1924039991715,1cyclictest0-21swapper/007:41:440
1924039991712,3cyclictest1987811-21tr10:20:100
192405099165,10cyclictest3056-21PK-Backend07:25:003
1924050991614,1cyclictest0-21swapper/307:38:413
192404899168,6cyclictest436-20systemd-journal10:54:592
192404899160,6cyclictest34-21ksoftirqd/209:20:112
1924043991613,2cyclictest3056-21PK-Backend11:11:021
1924043991613,2cyclictest3056-21PK-Backend09:11:461
1924043991513,1cyclictest3056-21PK-Backend11:25:351
1924043991513,1cyclictest3056-21PK-Backend10:56:301
1924043991513,1cyclictest3056-21PK-Backend08:23:391
1924043991412,1cyclictest3056-21PK-Backend08:07:511
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional