You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-10 - 14:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Wed Jun 10, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
243492237163,24sleep20-21swapper/207:06:222
243532236163,24sleep10-21swapper/107:06:251
245002200164,24sleep30-21swapper/307:08:203
243172200164,24sleep00-21swapper/007:05:570
1346621770,4sleep12471799cyclictest09:10:021
1676121680,4sleep12471799cyclictest08:00:271
24724991112,107cyclictest0-21swapper/208:12:542
24724998380,2cyclictest0-21swapper/207:28:402
2472499421,31cyclictest0-21swapper/210:37:532
33412410,2sleep10-21swapper/112:25:181
24729994128,3cyclictest0-21swapper/307:12:053
2472499381,11cyclictest0-21swapper/212:37:132
2472499371,27cyclictest0-21swapper/210:07:392
2472499371,11cyclictest0-21swapper/210:56:292
2472499371,11cyclictest0-21swapper/210:56:292
2472499371,11cyclictest0-21swapper/209:45:232
2472499371,11cyclictest0-21swapper/209:45:232
24729993621,3cyclictest0-21swapper/310:00:053
24729993616,11cyclictest0-21swapper/310:39:413
2472499361,33cyclictest0-21swapper/209:02:492
157672360,4sleep22472499cyclictest10:25:232
24729993522,8cyclictest0-21swapper/309:50:093
24729993519,3cyclictest0-21swapper/310:21:053
2472499351,27cyclictest0-21swapper/207:31:412
2470899351,21cyclictest20991-21kworker/0:111:55:170
24729993424,3cyclictest0-21swapper/308:58:373
24729993423,3cyclictest0-21swapper/309:02:493
24729993419,7cyclictest0-21swapper/309:35:053
24729993419,6cyclictest0-21swapper/307:33:013
2472999341,25cyclictest1319-21rt-features12:20:213
2472999341,14cyclictest0-21swapper/309:34:173
2472499341,10cyclictest0-21swapper/212:24:012
2470899342,13cyclictest2329-21kworker/0:008:50:210
24729993321,3cyclictest13425-21diskmemload10:55:453
24729993321,3cyclictest13425-21diskmemload10:55:453
24729993320,3cyclictest0-21swapper/311:46:533
24729993320,3cyclictest0-21swapper/310:48:013
24729993320,3cyclictest0-21swapper/310:34:413
24729993317,8cyclictest0-21swapper/312:27:093
24729993317,8cyclictest0-21swapper/311:35:093
24729993317,8cyclictest0-21swapper/310:40:413
24729993316,7cyclictest0-21swapper/311:03:133
24729993316,7cyclictest0-21swapper/308:08:533
24729993315,9cyclictest0-21swapper/308:49:053
2472999331,22cyclictest0-21swapper/309:23:293
2472499331,9cyclictest0-21swapper/211:32:052
2472499331,21cyclictest0-21swapper/208:44:372
2472499331,11cyclictest0-21swapper/209:58:332
24729993220,3cyclictest0-21swapper/310:53:493
24729993219,3cyclictest0-21swapper/312:13:253
24729993215,7cyclictest0-21swapper/308:29:453
24729993215,7cyclictest0-21swapper/307:35:293
24729993215,4cyclictest0-21swapper/307:48:013
24729993215,3cyclictest0-21swapper/308:14:333
24729993214,8cyclictest0-21swapper/309:10:053
24729993213,7cyclictest21034-40dnf11:52:253
24729993211,9cyclictest30620-21/usr/sbin/munin08:35:133
2472499321,21cyclictest0-21swapper/211:12:092
2472499321,21cyclictest0-21swapper/209:12:212
2472499321,21cyclictest0-21swapper/208:24:412
2472499321,20cyclictest0-21swapper/208:28:452
24729993118,3cyclictest0-21swapper/312:19:293
24729993118,3cyclictest0-21swapper/309:09:253
24729993117,4cyclictest0-21swapper/309:55:573
24729993114,7cyclictest0-21swapper/308:41:333
24729993113,8cyclictest0-21swapper/312:32:093
24729993112,10cyclictest0-21swapper/310:05:293
2472999311,13cyclictest0-21swapper/311:13:373
24729993111,11cyclictest0-21swapper/311:25:373
2472499311,21cyclictest0-21swapper/212:27:332
2472499311,14cyclictest0-21swapper/210:15:532
2472499311,14cyclictest0-21swapper/210:01:372
2472499311,12cyclictest28429-21df_inode12:10:132
2472499311,12cyclictest0-21swapper/208:01:172
24729993018,3cyclictest0-21swapper/311:33:453
24729993018,3cyclictest0-21swapper/307:19:373
2472999301,22cyclictest0-21swapper/309:47:453
2472999301,22cyclictest0-21swapper/309:47:453
2472999301,12cyclictest0-21swapper/312:38:333
2472499301,21cyclictest0-21swapper/211:49:332
2472499301,20cyclictest0-21swapper/208:06:012
2472499301,19cyclictest0-21swapper/211:26:452
2472499301,14cyclictest0-21swapper/211:20:492
2472499301,12cyclictest0-21swapper/209:20:572
2472499301,12cyclictest0-21swapper/207:45:292
2470899307,11cyclictest28823-21awk09:45:010
2470899302,12cyclictest30700-21kworker/0:110:10:130
2472999298,8cyclictest0-21swapper/308:22:133
2472999292,14cyclictest4969-21ntp_states11:15:213
24729992917,3cyclictest0-21swapper/308:50:413
24729992917,3cyclictest0-21swapper/307:55:533
24729992915,10cyclictest0-21swapper/309:16:053
24729992912,7cyclictest0-21swapper/307:54:053
2472999290,13cyclictest0-21swapper/310:26:253
2472499291,13cyclictest0-21swapper/210:21:452
2472499291,12cyclictest0-21swapper/212:07:052
2472499291,12cyclictest0-21swapper/207:37:332
2472499291,11cyclictest0-21swapper/210:46:252
2472999288,8cyclictest0-21swapper/307:40:413
2472999287,11cyclictest0-21swapper/310:18:053
2472999286,8cyclictest0-21swapper/309:29:383
24729992817,3cyclictest0-21swapper/312:07:493
2472999281,19cyclictest0-21swapper/311:06:253
2472499281,11cyclictest0-21swapper/212:01:012
2472499281,11cyclictest0-21swapper/210:41:092
2472499281,11cyclictest0-21swapper/209:27:572
2472499281,11cyclictest0-21swapper/209:18:012
2472499280,8cyclictest0-21swapper/207:40:512
2472499280,20cyclictest0-21swapper/211:00:452
2470899282,9cyclictest29354-21kworker/0:311:25:170
2470899281,11cyclictest19936-21kworker/0:009:27:050
24729992713,3cyclictest0-21swapper/308:18:213
24729992712,3cyclictest0-21swapper/307:21:173
24729992712,3cyclictest0-21swapper/307:21:173
2472999271,18cyclictest0-21swapper/311:43:573
2472999271,13cyclictest0-21swapper/307:29:453
2472999270,22cyclictest0-21swapper/309:40:053
2472999270,18cyclictest0-21swapper/310:14:333
2472499271,19cyclictest0-21swapper/207:50:492
2472499271,13cyclictest0-21swapper/211:51:332
2472499271,10cyclictest0-21swapper/212:32:012
2471799272,4cyclictest4631-21munin-run08:50:011
2470899270,13cyclictest12476-21perf11:35:010
2470899270,12cyclictest28209-21awk08:30:010
111472270,1sleep10-21swapper/111:30:161
2472999268,3cyclictest0-21swapper/308:04:013
2472999266,11cyclictest0-21swapper/311:55:573
24729992611,3cyclictest24754-21ntp_states12:00:213
2472999261,10cyclictest0-21swapper/311:25:013
2472499261,23cyclictest0-21swapper/210:50:492
2472499261,15cyclictest0-21swapper/209:38:052
2472499261,13cyclictest0-21swapper/209:41:572
2472499261,13cyclictest0-21swapper/209:06:572
2472499261,13cyclictest0-21swapper/208:30:452
2472499261,12cyclictest13840-21irqstats07:55:172
2472499261,11cyclictest0-21swapper/208:36:572
2472499261,10cyclictest0-21swapper/211:36:012
2472499260,12cyclictest13425-21diskmemload12:17:052
2470899262,9cyclictest12395-21kworker/0:211:37:010
2470899262,14cyclictest2830-21kworker/0:309:57:290
2470899262,11cyclictest17651-21kworker/0:209:35:490
2470899262,10cyclictest10881-21kworker/0:009:05:130
24708992616,7cyclictest13942-21memory07:55:180
2472999258,9cyclictest0-21swapper/308:30:293
2472499251,9cyclictest0-21swapper/207:22:472
2472499251,9cyclictest0-21swapper/207:22:472
2471799251,19cyclictest0-21swapper/112:24:491
2471799251,15cyclictest13913-21rt-features11:35:231
2470899256,16cyclictest8685-21munin-run12:40:010
2470899251,9cyclictest16890-21kworker/0:308:05:190
2470899251,12cyclictest1831-21awk07:30:010
2472499241,8cyclictest0-21swapper/207:10:032
2472499241,13cyclictest0-21swapper/210:13:212
2472499241,11cyclictest0-21swapper/208:55:422
2472499241,11cyclictest0-21swapper/208:47:582
2471799241,10cyclictest26612-21munin-run09:40:011
2470899242,9cyclictest14616-21kworker/0:011:50:170
24708992410,2cyclictest1749-21kworker/0:107:50:170
2472499231,12cyclictest0-21swapper/209:50:372
2472499231,11cyclictest0-21swapper/210:32:012
2472499231,10cyclictest0-21swapper/208:18:372
2471799232,15cyclictest0-21swapper/112:34:221
2471799232,15cyclictest0-21swapper/110:47:141
2471799232,11cyclictest716-21diskstats08:40:131
2471799232,11cyclictest20019-21munin-run09:25:011
24717992316,4cyclictest27864-21munin-run12:10:011
24717992315,3cyclictest0-21swapper/108:20:401
2471799231,3cyclictest28863-21if_err_enp1s012:10:171
2471799231,3cyclictest23680-21sendmail_mailst09:30:221
2470899238,14cyclictest0-21swapper/012:10:010
2470899232,9cyclictest26564-21kworker/0:108:37:230
2470899232,9cyclictest14616-21kworker/0:011:45:170
2470899232,11cyclictest10881-21kworker/0:009:04:570
2470899231,8cyclictest28083-21kworker/0:312:25:210
2470899231,12cyclictest5044-21kworker/0:010:21:370
2470899231,10cyclictest28083-21kworker/0:312:10:180
2472499221,10cyclictest1382-21taskset11:09:152
2472499221,10cyclictest0-21swapper/209:31:212
2472499220,11cyclictest0-21swapper/208:50:192
2471799222,15cyclictest0-21swapper/111:10:291
2471799222,15cyclictest0-21swapper/109:15:591
24717992214,3cyclictest0-21swapper/111:51:281
2471799221,3cyclictest9173-21cat09:00:021
2471799221,3cyclictest30427-21cat11:00:161
2471799221,16cyclictest0-21swapper/108:54:361
2471799221,15cyclictest0-21swapper/112:00:381
2471799221,15cyclictest0-21swapper/108:05:051
2470899222,9cyclictest1749-21kworker/0:107:34:410
2470899222,8cyclictest30700-21kworker/0:109:54:250
2470899222,10cyclictest22101-21kworker/0:309:46:290
2470899222,10cyclictest22101-21kworker/0:309:46:290
2470899222,10cyclictest13915-21kworker/0:310:34:370
2470899222,10cyclictest10881-21kworker/0:009:12:130
2470899221,8cyclictest14616-21kworker/0:011:43:210
2470899221,13cyclictest13915-21kworker/0:310:37:130
2470899221,12cyclictest16913-21ntp_states09:15:200
221092220,4sleep230-21rcuc/211:55:172
208862220,4sleep1221ktimersoftd/109:25:151
275172211,2sleep027714-21entropy07:15:040
2472499211,13cyclictest0-21swapper/207:19:012
2472499210,7cyclictest0-21swapper/211:43:392
2471799219,3cyclictest1460-21munin-run11:10:011
2471799218,4cyclictest20699-21ntp_states08:10:211
2471799214,5cyclictest0-21swapper/109:50:121
2471799211,9cyclictest0-21swapper/107:15:031
24717992117,3cyclictest0-21swapper/111:58:241
24717992114,2cyclictest0-21swapper/111:29:291
24717992113,3cyclictest0-21swapper/111:42:421
24717992113,3cyclictest0-21swapper/110:34:211
2471799211,17cyclictest4361-21cut11:15:151
2471799211,13cyclictest0-21swapper/109:10:171
2471799211,10cyclictest32264-21awk12:20:011
2471799210,15cyclictest0-21swapper/110:55:441
2471799210,15cyclictest0-21swapper/110:55:441
2471799210,15cyclictest0-21swapper/110:25:161
2470899218,2cyclictest3699-21kworker/0:207:11:270
2470899212,9cyclictest5546-21kworker/0:111:16:570
2470899212,9cyclictest3969-21kworker/0:112:30:490
2470899212,9cyclictest29354-21kworker/0:311:21:170
2470899212,11cyclictest18043-21/usr/sbin/munin09:20:240
2470899212,10cyclictest28083-21kworker/0:312:15:500
2470899211,9cyclictest24679-21kworker/0:110:49:570
2470899211,9cyclictest22101-21kworker/0:309:30:090
2470899211,9cyclictest13915-21kworker/0:310:25:130
2470899211,9cyclictest12513-21kworker/0:008:18:170
24708992116,3cyclictest3933-21cut10:00:160
2470899211,11cyclictest29196-21kworker/0:011:01:010
2470899211,11cyclictest1749-21kworker/0:107:44:130
2470899211,11cyclictest1032-21sed12:20:170
2470899211,10cyclictest13915-21kworker/0:310:43:130
2471799205,4cyclictest0-21swapper/109:44:231
2471799202,14cyclictest0-21swapper/111:22:541
2471799201,9cyclictest10835-21sed10:15:161
2471799201,9cyclictest0-21swapper/110:08:541
24717992016,3cyclictest0-21swapper/109:04:411
24717992016,3cyclictest0-21swapper/107:26:471
2471799201,2cyclictest13425-21diskmemload12:36:541
2471799201,18cyclictest0-21swapper/107:13:561
2471799201,17cyclictest0-21swapper/107:50:131
2471799201,15cyclictest0-21swapper/109:57:071
2471799201,14cyclictest0-21swapper/110:37:471
2471799201,14cyclictest0-21swapper/110:00:311
2471799201,11cyclictest7502-21ntp_states07:40:201
2471799201,10cyclictest31854-21sendmail_mailqu08:35:251
2471799201,10cyclictest26990-21if_enp2s008:25:161
2471799201,10cyclictest12413-21/usr/sbin/munin10:20:121
2471799200,17cyclictest827-21runrttasks07:23:031
2471799200,17cyclictest827-21runrttasks07:23:031
2471799200,15cyclictest0-21swapper/108:32:131
2470899207,2cyclictest30700-21kworker/0:110:08:130
2470899202,9cyclictest8653-21kworker/0:108:55:410
2470899202,9cyclictest3699-21kworker/0:207:22:130
2470899202,9cyclictest3699-21kworker/0:207:22:130
2470899201,9cyclictest26564-21kworker/0:108:40:290
2470899201,9cyclictest1749-21kworker/0:107:36:250
2470899201,17cyclictest26564-21kworker/0:108:30:130
2470899201,12cyclictest20991-21kworker/0:112:03:410
2470899201,11cyclictest0-21swapper/011:13:230
2470899201,10cyclictest24679-21kworker/0:110:50:370
2471799198,3cyclictest13376-21diskstats07:55:141
2471799191,8cyclictest0-21swapper/110:50:311
24717991912,2cyclictest0-21swapper/110:10:581
24717991912,2cyclictest0-21swapper/108:16:261
2471799191,16cyclictest0-21swapper/110:40:071
2471799191,16cyclictest0-21swapper/107:38:461
2470899196,4cyclictest0-21swapper/010:57:270
2470899196,4cyclictest0-21swapper/010:57:270
2470899194,3cyclictest0-21swapper/010:17:420
2470899191,9cyclictest0-21swapper/011:05:270
2470899191,8cyclictest26564-21kworker/0:108:48:370
2470899191,8cyclictest23640-21kworker/0:208:23:090
24708991913,4cyclictest10155-21grep07:45:270
2472499181,6cyclictest0-21swapper/211:16:532
2471799184,6cyclictest0-21swapper/109:45:171
2471799184,6cyclictest0-21swapper/109:45:171
2471799181,16cyclictest0-21swapper/107:31:271
24717991811,2cyclictest0-21swapper/107:45:371
2471799181,10cyclictest0-21swapper/111:49:351
2470899180,9cyclictest12513-21kworker/0:008:10:450
2470899178,2cyclictest0-21swapper/008:00:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional