You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 17:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #c, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackcslot7s.osadl.org (updated Sat Jul 04, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236736221370,3sleep30-21swapper/308:20:003
23421202960,9sleep10-21swapper/107:10:011
234189827839,13sleep30-21swapper/307:08:003
234186326443,14sleep20-21swapper/207:07:422
234056926141,14sleep00-21swapper/007:05:070
24496222400,2sleep20-21swapper/212:10:202
234219399390,19cyclictest2416622-21apt-config10:40:013
234219399360,19cyclictest2344093-21taskset07:15:013
234219399360,19cyclictest2344093-21taskset07:15:013
234219399340,22cyclictest2377754-21taskset08:48:423
234219399340,19cyclictest0-21swapper/308:53:473
234219399331,17cyclictest2396997-21taskset09:42:323
234219399330,17cyclictest2448586-21sed12:10:013
234219399322,17cyclictest883-21dbus-daemon08:10:003
234219399321,17cyclictest2423434-21taskset10:59:403
234219399320,18cyclictest0-21swapper/307:50:003
234219399320,17cyclictest0-21swapper/309:28:533
234219399310,18cyclictest2407588-21taskset10:14:573
234219399301,16cyclictest2395504-21munin-run09:40:003
234219399300,19cyclictest1211-21kerneloops12:24:163
234219399300,18cyclictest0-21swapper/312:17:063
234219399300,18cyclictest0-21swapper/311:04:403
234219399300,18cyclictest0-21swapper/308:00:593
234219399300,17cyclictest2358008-21taskset07:51:403
234219399300,17cyclictest0-21swapper/311:44:383
234219399300,17cyclictest0-21swapper/308:35:273
2342193992912,15cyclictest2364531-21cat08:10:163
234219399290,18cyclictest0-21swapper/307:42:023
234219399290,17cyclictest2376115-21taskset08:44:543
234219399290,17cyclictest0-21swapper/312:28:213
234219399290,17cyclictest0-21swapper/311:36:003
234219399290,16cyclictest2426914-21runrttasks11:09:493
234219399290,16cyclictest2426914-21runrttasks11:09:493
234219399290,16cyclictest2417220-21idleruntime10:40:173
234219399290,16cyclictest0-21swapper/309:51:263
234219399280,16cyclictest0-21swapper/312:12:453
234219399280,16cyclictest0-21swapper/312:02:383
234219399280,16cyclictest0-21swapper/312:02:383
234219399280,16cyclictest0-21swapper/309:47:053
234219399280,16cyclictest0-21swapper/307:37:183
234219399280,16cyclictest0-21swapper/307:10:463
234219399280,15cyclictest0-21swapper/310:52:423
234219399272,23cyclictest0-21swapper/308:57:593
234219399262,22cyclictest2382310-21ntpq09:00:183
234219399260,24cyclictest436-20systemd-journal11:10:433
234219399260,24cyclictest2414556-21munin-run10:35:003
234219399260,15cyclictest0-21swapper/309:23:473
234219399260,15cyclictest0-21swapper/308:26:103
234219399260,12cyclictest2367211-21apt-get08:20:023
234219399253,20cyclictest2412818-21munin-plugin-st10:30:003
234219399252,19cyclictest2409611-21apt10:20:123
234219399250,23cyclictest2440916-21seq11:48:133
2342189992519,4cyclictest2376141-21sh08:45:002
139099250,4rtkit-daemon1389-21rtkit-daemon08:00:172
139099250,18rtkit-daemon3056-21PK-Backend07:12:331
234219399247,15cyclictest2347317-21sed07:20:203
2342193992418,4cyclictest2385386-21cstates09:10:133
234219399241,21cyclictest2401880-21find09:55:223
2342193992411,9cyclictest1-21systemd08:32:353
234219399240,22cyclictest2432144-21grep11:25:003
2342186992412,10cyclictest2356553-21munin-plugin-st07:50:011
23868722230,9sleep013-21ksoftirqd/009:15:110
234219399236,15cyclictest2392494-21cat09:30:123
2342193992312,9cyclictest2458281-21latency12:35:163
234219399231,20cyclictest2444318-21/usr/sbin/munin11:55:233
234219399231,19cyclictest2402893-21expr10:00:103
234219399230,21cyclictest2455985-21/usr/sbin/munin12:30:163
234219399230,20cyclictest2383462-21cpuspeed_turbos09:05:133
234219399230,13cyclictest0-21swapper/311:50:013
234219399230,13cyclictest0-21swapper/307:55:013
2342189992311,10cyclictest2411063-21cron10:25:002
234219399227,14cyclictest2405867-21cron10:10:003
234219399227,13cyclictest2429341-21which11:15:163
234219399227,13cyclictest2348223-21cpuspeed_turbos07:25:143
234219399221,19cyclictest42-21ksoftirqd/310:19:133
234219399220,20cyclictest2434311-21cpuspeed_turbos11:30:133
234219399220,20cyclictest2386982-21expr09:15:113
234219399220,20cyclictest2351280-21grep07:35:013
234218999226,14cyclictest2432175-21unin-run11:25:002
2342189992220,1cyclictest0-21swapper/210:57:422
2342189992220,1cyclictest0-21swapper/210:53:502
234218999220,20cyclictest2436249-21df_inode11:35:142
234218999220,19cyclictest2394871-21seq09:35:212
2342186992213,7cyclictest2376140-21cron08:45:011
2342182992220,1cyclictest0-21swapper/010:42:430
2342182992220,1cyclictest0-21swapper/009:37:270
2342182992220,1cyclictest0-21swapper/009:00:500
2342182992220,1cyclictest0-21swapper/008:55:300
2342182992220,1cyclictest0-21swapper/007:54:390
2342182992215,5cyclictest2448266-21apt-get12:10:000
234218299220,21cyclictest0-21swapper/011:05:410
234218299220,21cyclictest0-21swapper/011:05:410
234218299220,20cyclictest3056-21PK-Backend09:55:180
24316552210,3sleep13056-21PK-Backend11:20:231
234219399211,18cyclictest2418706-21cut10:45:133
234219399210,19cyclictest2432563-21expr11:25:133
2342189992119,1cyclictest0-21swapper/212:36:452
2342189992119,1cyclictest0-21swapper/212:09:342
2342189992119,1cyclictest0-21swapper/211:19:392
2342189992119,1cyclictest0-21swapper/211:07:362
2342189992119,1cyclictest0-21swapper/211:07:362
2342189992119,1cyclictest0-21swapper/210:36:132
2342189992119,1cyclictest0-21swapper/209:49:012
2342189992119,1cyclictest0-21swapper/209:32:462
2342189992119,1cyclictest0-21swapper/209:24:142
2342189992119,1cyclictest0-21swapper/208:53:522
2342189992119,1cyclictest0-21swapper/208:16:342
2342189992115,4cyclictest978-21snmpd08:56:212
2342189992114,5cyclictest2343524-21seq07:10:532
234218999210,20cyclictest0-21swapper/212:28:132
234218999210,20cyclictest0-21swapper/212:17:252
234218999210,20cyclictest0-21swapper/211:01:012
234218999210,20cyclictest0-21swapper/207:35:522
234218999210,20cyclictest0-21swapper/207:28:002
2342186992118,2cyclictest3056-21PK-Backend11:55:321
2342186992118,2cyclictest3056-21PK-Backend09:58:301
2342186992118,2cyclictest3056-21PK-Backend09:29:441
2342186992118,2cyclictest3056-21PK-Backend09:20:171
2342186992117,2cyclictest2372916-21/usr/sbin/munin08:35:151
234218699210,19cyclictest3056-21PK-Backend11:47:331
234218699210,19cyclictest3056-21PK-Backend11:13:131
2342182992119,1cyclictest0-21swapper/012:38:150
2342182992119,1cyclictest0-21swapper/012:28:220
2342182992119,1cyclictest0-21swapper/011:56:240
2342182992119,1cyclictest0-21swapper/010:56:350
2342182992119,1cyclictest0-21swapper/010:33:440
2342182992119,1cyclictest0-21swapper/010:07:010
2342182992119,1cyclictest0-21swapper/009:42:470
2342182992119,1cyclictest0-21swapper/009:32:540
2342182992119,1cyclictest0-21swapper/009:27:330
2342182992119,1cyclictest0-21swapper/009:10:090
2342182992119,1cyclictest0-21swapper/009:07:460
2342182992119,1cyclictest0-21swapper/008:37:310
2342182992119,1cyclictest0-21swapper/008:10:340
2342182992119,1cyclictest0-21swapper/007:39:450
2342182992118,2cyclictest3056-21PK-Backend11:15:020
2342182992118,2cyclictest3056-21PK-Backend10:35:540
234218299210,20cyclictest3056-21PK-Backend10:03:150
234218299210,20cyclictest3056-21PK-Backend08:05:200
234218299210,20cyclictest0-21swapper/012:03:280
234218299210,20cyclictest0-21swapper/012:03:270
234218299210,20cyclictest0-21swapper/008:41:570
234218299210,20cyclictest0-21swapper/007:28:300
24349592200,4sleep00-21swapper/011:30:200
23448922200,4sleep00-21swapper/007:15:130
23448922200,4sleep00-21swapper/007:15:130
2342189992018,1cyclictest0-21swapper/212:30:362
2342189992018,1cyclictest0-21swapper/212:00:222
2342189992018,1cyclictest0-21swapper/212:00:222
2342189992018,1cyclictest0-21swapper/211:27:512
2342189992018,1cyclictest0-21swapper/210:30:322
2342189992018,1cyclictest0-21swapper/209:53:002
2342189992018,1cyclictest0-21swapper/209:15:082
2342189992018,1cyclictest0-21swapper/208:39:192
2342189992018,1cyclictest0-21swapper/208:24:252
2342189992018,1cyclictest0-21swapper/207:47:202
2342189992018,1cyclictest0-21swapper/207:40:182
2342189992014,4cyclictest913-21gdbus10:50:002
2342189992012,6cyclictest2417377-21cat10:40:182
2342189992011,7cyclictest2377871-21sh08:50:002
2342189992011,7cyclictest2345096-21awk07:15:162
2342189992011,7cyclictest2345096-21awk07:15:162
234218999200,1cyclictest0-21swapper/211:30:342
234218999200,1cyclictest0-21swapper/209:56:112
234218999200,19cyclictest2390000-21apt-get09:25:012
234218999200,19cyclictest0-21swapper/211:12:152
234218999200,19cyclictest0-21swapper/210:18:352
234218999200,19cyclictest0-21swapper/210:07:062
234218999200,19cyclictest0-21swapper/210:01:462
234218999200,19cyclictest0-21swapper/209:13:322
234218999200,19cyclictest0-21swapper/209:00:142
234218999200,19cyclictest0-21swapper/207:30:372
2342186992018,1cyclictest3056-21PK-Backend12:31:131
2342186992018,1cyclictest3056-21PK-Backend10:18:241
2342186992018,1cyclictest3056-21PK-Backend09:37:001
2342186992018,1cyclictest3056-21PK-Backend09:19:301
2342186992018,1cyclictest3056-21PK-Backend09:13:491
2342186992018,1cyclictest3056-21PK-Backend08:53:541
2342186992018,1cyclictest3056-21PK-Backend07:15:271
2342186992018,1cyclictest3056-21PK-Backend07:15:271
2342186992018,1cyclictest0-21swapper/112:26:061
2342186992018,1cyclictest0-21swapper/111:30:381
2342186992018,1cyclictest0-21swapper/110:35:071
2342186992017,2cyclictest3056-21PK-Backend08:13:531
234218699200,1cyclictest3056-21PK-Backend10:26:221
234218699200,1cyclictest3056-21PK-Backend10:11:151
234218699200,18cyclictest3056-21PK-Backend11:17:391
234218699200,18cyclictest3056-21PK-Backend09:45:061
2342182992018,1cyclictest0-21swapper/012:16:110
2342182992018,1cyclictest0-21swapper/010:47:430
2342182992018,1cyclictest0-21swapper/010:22:360
2342182992018,1cyclictest0-21swapper/009:52:550
2342182992018,1cyclictest0-21swapper/007:34:320
2342182992012,6cyclictest2359393-21memory07:55:190
234218299200,7cyclictest13-21ksoftirqd/009:45:120
234218299200,19cyclictest3056-21PK-Backend07:49:250
234218299200,19cyclictest0-21swapper/011:47:250
234218299200,19cyclictest0-21swapper/010:50:130
234218299200,19cyclictest0-21swapper/008:18:250
234218299200,19cyclictest0-21swapper/007:11:460
234218999193,14cyclictest2384800-21sh09:10:002
2342189991917,1cyclictest0-21swapper/212:21:442
2342189991917,1cyclictest0-21swapper/211:53:532
2342189991917,1cyclictest0-21swapper/211:45:072
2342189991917,1cyclictest0-21swapper/208:34:532
2342189991912,5cyclictest2443947-21cat11:55:192
234218999190,1cyclictest0-21swapper/210:13:072
234218999190,18cyclictest0-21swapper/208:12:572
234218999190,18cyclictest0-21swapper/207:57:002
234218999190,18cyclictest0-21swapper/207:52:342
2342186991917,1cyclictest3056-21PK-Backend12:19:171
2342186991917,1cyclictest3056-21PK-Backend12:12:271
2342186991917,1cyclictest3056-21PK-Backend09:06:321
2342186991916,2cyclictest3056-21PK-Backend08:18:541
2342186991912,5cyclictest2357211-21fw_packets07:50:151
2342186991911,6cyclictest2447201-21fw_packets12:05:141
234218699190,1cyclictest3056-21PK-Backend11:06:521
234218699190,1cyclictest3056-21PK-Backend11:06:511
234218699190,1cyclictest3056-21PK-Backend10:48:171
234218699190,1cyclictest3056-21PK-Backend10:32:231
234218699190,1cyclictest3056-21PK-Backend09:30:311
234218699190,1cyclictest3056-21PK-Backend08:59:491
234218699190,1cyclictest0-21swapper/111:25:231
234218699190,18cyclictest3056-21PK-Backend08:00:411
234218299193,14cyclictest2369618-21cpuspeed_turbos08:25:120
2342182991917,1cyclictest0-21swapper/012:33:420
2342182991917,1cyclictest0-21swapper/012:20:310
2342182991917,1cyclictest0-21swapper/011:36:230
2342182991917,1cyclictest0-21swapper/008:51:040
2342182991917,1cyclictest0-21swapper/008:23:390
2342182991917,1cyclictest0-21swapper/008:00:070
2342182991912,5cyclictest2428677-21grep11:15:010
234218299190,1cyclictest3056-21PK-Backend11:40:160
234218299190,1cyclictest0-21swapper/012:14:020
234218299190,1cyclictest0-21swapper/009:22:130
234218299190,1cyclictest0-21swapper/008:33:050
234218299190,18cyclictest3056-21PK-Backend10:15:460
234218299190,18cyclictest0-21swapper/011:29:000
2342189991816,1cyclictest0-21swapper/211:43:452
2342189991816,1cyclictest0-21swapper/210:28:222
2342189991816,1cyclictest0-21swapper/209:40:292
2342189991816,1cyclictest0-21swapper/208:07:432
2342186991816,1cyclictest3056-21PK-Backend12:36:201
2342186991816,1cyclictest3056-21PK-Backend10:23:041
2342186991816,1cyclictest3056-21PK-Backend09:40:471
2342186991816,1cyclictest0-21swapper/108:45:311
2342186991815,2cyclictest3056-21PK-Backend10:06:481
234218699180,1cyclictest3056-21PK-Backend09:04:351
234218699180,17cyclictest3056-21PK-Backend08:08:531
2342182991816,1cyclictest0-21swapper/008:47:240
2342182991810,6cyclictest2411806-21cat10:25:190
2342189991715,1cyclictest0-21swapper/208:26:142
2342186991715,1cyclictest3056-21PK-Backend10:40:351
2342186991714,2cyclictest3056-21PK-Backend10:50:551
2342186991710,5cyclictest2399462-21cat09:50:111
2342182991715,1cyclictest0-21swapper/011:54:150
234218999169,5cyclictest2346617-21expr07:20:112
2342186991614,1cyclictest3056-21PK-Backend12:23:221
2342186991614,1cyclictest3056-21PK-Backend11:36:591
2342186991614,1cyclictest3056-21PK-Backend10:55:081
2342186991614,1cyclictest3056-21PK-Backend07:34:521
2342186991611,3cyclictest2425213-21idleruntime-cro11:05:001
2342186991610,5cyclictest2403562-21sed10:00:191
2342186991610,4cyclictest2438338-21awk11:40:191
2342186991610,4cyclictest2372724-21date08:35:001
2342182991614,1cyclictest3056-21PK-Backend10:14:240
2342182991610,5cyclictest883-21dbus-daemon07:45:000
234218699159,4cyclictest2351728-21tr07:35:121
2342186991513,1cyclictest3056-21PK-Backend11:51:251
2342186991513,1cyclictest3056-21PK-Backend07:23:441
2342182991513,1cyclictest0-21swapper/011:24:200
234218299151,12cyclictest2346502-21cpuspeed_turbos07:20:120
234218699148,5cyclictest2368462-21grep08:20:201
2342186991412,1cyclictest3056-21PK-Backend07:44:531
2342186991411,2cyclictest3056-21PK-Backend12:04:161
2342186991411,2cyclictest3056-21PK-Backend12:04:161
2342186991410,3cyclictest3056-21PK-Backend07:57:411
234218299148,4cyclictest2423884-21tr11:00:130
234218699137,5cyclictest2371070-21sed08:30:001
234218699118,2cyclictest3056-21PK-Backend07:25:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional