You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 23:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Mon Jul 20, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319792239163,24sleep30-21swapper/307:10:003
300142234162,23sleep20-21swapper/207:05:042
318652216189,18sleep00-21swapper/007:08:320
318272201164,24sleep10-21swapper/107:08:041
91421740,5sleep23207399cyclictest09:35:262
1485221340,4sleep03206199cyclictest11:20:260
1987821320,1sleep10-21swapper/109:05:231
310882610,4sleep121-21rcuc/112:00:121
191052600,4sleep341-21ksoftirqd/307:50:203
228402590,2sleep10-21swapper/108:00:121
214252520,5sleep021427-21fschecks_count09:10:140
194252510,4sleep23207399cyclictest10:20:122
111662460,2sleep00-21swapper/010:00:160
195012420,3sleep00-21swapper/009:05:170
32073993735,1cyclictest0-21swapper/208:30:222
3206199371,10cyclictest13901-21kworker/0:209:00:270
3206199371,10cyclictest13901-21kworker/0:209:00:270
3207999351,20cyclictest20774-21diskmemload12:13:153
3206199352,10cyclictest2814-21kworker/0:112:23:500
32079993421,4cyclictest0-21swapper/310:20:153
3206199341,9cyclictest29333-21kworker/0:009:38:300
3206199341,24cyclictest30099-21kworker/0:110:44:470
32079993319,3cyclictest14417-21users10:05:273
3206199334,14cyclictest19806-21munin-run11:35:010
3207999321,21cyclictest0-21swapper/312:16:073
3206199322,9cyclictest32156-21kworker/0:209:48:430
3207999311,20cyclictest0-21swapper/312:01:353
3207999311,12cyclictest0-21swapper/311:34:223
3207999301,20cyclictest0-21swapper/311:26:223
3207999301,19cyclictest0-21swapper/309:32:593
3207399301,11cyclictest0-21swapper/212:08:452
3206999301,18cyclictest30751-21diskstats10:45:151
3206199301,16cyclictest21178-21kworker/0:010:24:030
3206199301,11cyclictest1768-21kworker/0:007:30:340
3207999291,19cyclictest0-21swapper/309:21:073
3207999291,12cyclictest0-21swapper/312:35:593
3207999290,13cyclictest0-21swapper/309:50:313
3207399291,12cyclictest0-21swapper/211:16:452
3206199291,22cyclictest11461-21kworker/0:212:35:390
3206199291,21cyclictest26971-21kworker/0:111:53:060
3207999280,13cyclictest0-21swapper/311:10:463
3207399281,12cyclictest0-21swapper/209:47:012
3207399280,12cyclictest0-21swapper/210:33:562
3206199286,10cyclictest22018-21awk11:40:000
3206199284,12cyclictest6979-21awk07:25:010
3207999271,17cyclictest0-21swapper/310:49:223
3207999271,13cyclictest0-21swapper/310:54:383
3207999271,13cyclictest0-21swapper/310:15:353
3207999271,12cyclictest0-21swapper/311:43:263
3207999271,12cyclictest0-21swapper/310:11:313
3207999271,12cyclictest0-21swapper/310:11:313
3207399271,12cyclictest0-21swapper/208:40:242
3207399271,10cyclictest0-21swapper/209:02:572
3207399271,10cyclictest0-21swapper/209:02:572
3206999271,17cyclictest9394-21users08:40:271
3206199277,8cyclictest18394-21kworker/0:109:28:180
3206199272,11cyclictest18394-21kworker/0:109:24:420
3206199271,9cyclictest4289-21kworker/0:011:03:590
3206199270,13cyclictest14811-21perf10:10:010
3207999261,13cyclictest20774-21diskmemload12:34:393
3207999261,13cyclictest0-21swapper/312:23:353
3207999261,12cyclictest0-21swapper/310:37:313
3207999261,12cyclictest0-21swapper/310:00:113
3207999261,11cyclictest0-21swapper/308:57:423
3207999261,11cyclictest0-21swapper/307:21:593
3207399261,10cyclictest0-21swapper/207:15:162
3207399260,11cyclictest0-21swapper/210:41:002
3206199262,9cyclictest28572-21kworker/0:312:07:420
3206199262,8cyclictest14501-21kworker/0:110:19:150
3206199262,10cyclictest10682-21kworker/0:211:11:230
3207999257,4cyclictest16937-21df_inode09:00:143
3207999257,4cyclictest16937-21df_inode09:00:143
3207999251,13cyclictest0-21swapper/307:49:473
3207999251,12cyclictest0-21swapper/312:09:033
3207999251,12cyclictest0-21swapper/311:52:513
3207999251,12cyclictest0-21swapper/310:57:503
3207999251,12cyclictest0-21swapper/308:21:273
3207999251,11cyclictest0-21swapper/307:56:513
3207999251,11cyclictest0-21swapper/307:56:513
3207399251,12cyclictest0-21swapper/208:26:282
3207399251,10cyclictest0-21swapper/208:56:252
3207399250,13cyclictest0-21swapper/210:57:522
3207399250,11cyclictest0-21swapper/210:17:092
3206999251,4cyclictest5994-21idleruntime-cro09:50:001
3206999251,3cyclictest959-21latency_hist08:25:011
3206999251,3cyclictest22431-21irqstats10:25:191
3206199256,16cyclictest15755-21munin-run07:45:000
3206199252,9cyclictest8010-21kworker/0:009:57:350
3206199251,9cyclictest10682-21kworker/0:211:25:510
3206199251,8cyclictest354-21kworker/0:012:04:300
3206199251,10cyclictest18950-21kworker/0:210:27:070
3207999248,9cyclictest9380-21unixbench_singl08:40:263
3207999241,13cyclictest0-21swapper/309:58:433
3207999241,13cyclictest0-21swapper/307:40:513
3207999241,12cyclictest0-21swapper/310:30:393
3207999240,13cyclictest0-21swapper/309:38:233
3207999240,12cyclictest0-21swapper/309:45:113
3207999240,11cyclictest0-21swapper/311:59:593
3207999240,10cyclictest0-21swapper/311:22:023
3207399241,11cyclictest0-21swapper/207:43:402
3207399240,11cyclictest0-21swapper/211:10:452
3206999242,2cyclictest87550irq/128-enp1s0-11:29:141
3206999242,16cyclictest0-21swapper/108:51:181
3206999241,15cyclictest1194-21/usr/sbin/munin08:25:251
3206199248,3cyclictest603-21kworker/0:108:23:150
3206199242,11cyclictest30402-21/usr/sbin/munin10:45:200
3206199241,3cyclictest20774-21diskmemload10:30:260
24292241,2sleep00-21swapper/008:25:250
3207999231,13cyclictest0-21swapper/307:25:513
3207999231,12cyclictest0-21swapper/311:16:223
3207999231,12cyclictest0-21swapper/311:02:103
3207999230,10cyclictest0-21swapper/309:12:193
3207399231,9cyclictest0-21swapper/211:25:572
3207399230,9cyclictest0-21swapper/209:28:532
3207399230,9cyclictest0-21swapper/207:12:162
3207399230,8cyclictest0-21swapper/211:02:362
3207399230,11cyclictest0-21swapper/207:55:162
3207399230,11cyclictest0-21swapper/207:55:162
3206999237,9cyclictest0-21swapper/111:19:031
3206999231,3cyclictest3426-21gltestperf07:15:171
3206999231,19cyclictest14405-21acpi08:55:121
3206999231,16cyclictest0-21swapper/109:54:461
3206999231,16cyclictest0-21swapper/107:25:241
3206999230,16cyclictest0-21swapper/109:15:201
3206199232,9cyclictest3112-21kworker/0:208:36:110
3206199232,11cyclictest28572-21kworker/0:311:55:380
3206199232,11cyclictest10932-21kworker/0:311:16:310
3206199231,10cyclictest20091-21kworker/0:307:58:510
3206199231,10cyclictest20091-21kworker/0:307:58:500
32061992310,2cyclictest4811-21kworker/0:212:16:180
3207999221,13cyclictest0-21swapper/307:36:353
3207399221,8cyclictest0-21swapper/212:30:252
3207399221,10cyclictest0-21swapper/208:19:402
3207399220,15cyclictest0-21swapper/212:10:212
3207399220,10cyclictest0-21swapper/211:20:332
3206999229,5cyclictest27615-21systemd-journal10:35:291
3206999222,15cyclictest0-21swapper/109:25:341
32069992218,3cyclictest0-21swapper/109:34:401
3206999221,18cyclictest1531-21hddtemp_smartct12:05:161
3206999221,15cyclictest0-21swapper/107:45:181
3206999221,12cyclictest6740-21grep08:35:241
3206999221,12cyclictest607-21ntp_states09:35:221
3206199229,3cyclictest7561-21kworker/0:008:46:050
3206199226,14cyclictest0-21swapper/007:15:020
3206199225,7cyclictest32058-21kworker/0:310:53:390
3206199225,2cyclictest3112-21kworker/0:208:40:270
3206199222,9cyclictest18394-21kworker/0:109:16:500
3206199222,9cyclictest15657-21kworker/0:107:52:220
3206199222,7cyclictest4515-21kworker/0:307:18:270
3206199222,10cyclictest3458-21kworker/0:309:51:510
3206199221,9cyclictest20091-21kworker/0:308:00:390
3206199221,12cyclictest13901-21kworker/0:208:54:590
3206199221,10cyclictest11461-21kworker/0:212:33:510
3207999212,2cyclictest87550irq/128-enp1s0-08:34:233
3207999211,3cyclictest0-21swapper/309:42:553
3207999211,3cyclictest0-21swapper/309:25:553
3207999211,14cyclictest0-21swapper/308:50:023
3207999211,11cyclictest0-21swapper/308:27:033
3207999211,10cyclictest0-21swapper/310:42:383
3207999210,14cyclictest0-21swapper/307:12:593
3207399217,3cyclictest0-21swapper/212:21:532
3207399211,2cyclictest0-21swapper/209:30:092
3207399211,10cyclictest0-21swapper/212:00:292
3206999212,14cyclictest87550irq/128-enp1s0-12:13:141
3206999212,11cyclictest19256-40dnf07:50:221
32069992116,3cyclictest9153-21tr11:10:141
32069992113,3cyclictest0-21swapper/109:42:491
32069992113,3cyclictest0-21swapper/107:37:201
3206999211,18cyclictest0-21swapper/111:52:061
3206999211,18cyclictest0-21swapper/111:05:251
3206999211,18cyclictest0-21swapper/109:10:211
3206999211,15cyclictest0-21swapper/109:57:551
3206999211,15cyclictest0-21swapper/109:04:291
3206999211,15cyclictest0-21swapper/109:04:291
3206999211,15cyclictest0-21swapper/108:19:261
3206999211,14cyclictest0-21swapper/108:12:291
3206199219,3cyclictest4289-21kworker/0:011:05:350
3206199219,3cyclictest10682-21kworker/0:211:48:400
3206199218,3cyclictest21818-21kworker/0:311:40:180
3206199218,2cyclictest26968-21kworker/0:108:15:030
3206199212,8cyclictest15657-21kworker/0:107:46:580
32061992114,2cyclictest13432-21kworker/0:307:39:380
3206199211,15cyclictest16145-21kworker/0:008:58:390
3206199211,10cyclictest4811-21kworker/0:212:14:500
55782200,2sleep20-21swapper/212:15:152
3207999203,3cyclictest0-21swapper/307:30:353
3207999202,8cyclictest26369-21users08:05:273
3207999202,8cyclictest11973-21munin-run08:50:003
3207999201,12cyclictest0-21swapper/312:26:153
3207999201,10cyclictest808-21snmpd08:12:553
3207399201,8cyclictest0-21swapper/211:08:212
3207399201,12cyclictest0-21swapper/208:23:242
3207399201,11cyclictest0-21swapper/210:08:212
3207399201,11cyclictest0-21swapper/209:44:372
3206999208,3cyclictest579-21systemd-journal11:05:011
3206999202,17cyclictest0-21swapper/110:58:251
32069992016,3cyclictest0-21swapper/111:37:121
32069992016,3cyclictest0-21swapper/111:30:451
32069992015,3cyclictest11856-21find10:00:231
3206999201,18cyclictest0-21swapper/111:44:381
3206999201,17cyclictest0-21swapper/112:37:061
3206999201,17cyclictest0-21swapper/111:46:381
3206999201,17cyclictest0-21swapper/110:50:181
3206999201,14cyclictest0-21swapper/110:20:351
3206999201,14cyclictest0-21swapper/110:16:161
3206999201,14cyclictest0-21swapper/110:11:061
3206999201,14cyclictest0-21swapper/110:11:061
3206999201,14cyclictest0-21swapper/110:07:441
3206999201,14cyclictest0-21swapper/109:23:481
3206999201,14cyclictest0-21swapper/108:09:181
3206999201,14cyclictest0-21swapper/107:21:401
3206999201,11cyclictest11996-21cpuspeed_turbos12:30:131
3206999200,15cyclictest0-21swapper/108:30:181
3206199208,2cyclictest1768-21kworker/0:007:25:100
3206199205,13cyclictest27310-21cat10:35:260
3206199202,9cyclictest29333-21kworker/0:009:30:220
3206199201,10cyclictest0-21swapper/009:41:460
3207999194,3cyclictest87650irq/129-enp1s0-09:05:213
3207999191,9cyclictest0-21swapper/308:35:323
3207999191,3cyclictest0-21swapper/308:00:233
3207999191,11cyclictest0-21swapper/308:16:133
3207999191,10cyclictest808-21snmpd10:28:193
3207399192,3cyclictest87350irq/126-enp1s0-12:25:022
3207399192,14cyclictest30561-21cut10:45:122
3207399191,9cyclictest0-21swapper/212:35:572
3207399191,9cyclictest0-21swapper/207:47:452
32073991914,3cyclictest15615-21grep10:10:162
32073991914,3cyclictest15615-21grep10:10:162
3207399191,3cyclictest0-21swapper/211:52:022
32073991913,3cyclictest26397-21sh11:50:022
3207399191,12cyclictest0-21swapper/209:52:012
3206999192,16cyclictest0-21swapper/112:28:041
3206999191,9cyclictest0-21swapper/110:30:011
3206999191,8cyclictest0-21swapper/107:30:231
32069991915,3cyclictest0-21swapper/111:58:551
32069991915,3cyclictest0-21swapper/111:24:291
3206999191,17cyclictest0-21swapper/112:17:111
3206999191,10cyclictest21659-21grep07:55:241
3206999191,10cyclictest21659-21grep07:55:241
32069991910,3cyclictest0-21swapper/107:40:171
3206999190,14cyclictest0-21swapper/108:45:311
3206199195,8cyclictest26968-21kworker/0:108:14:430
3206199195,4cyclictest8010-21kworker/0:010:12:110
3206199195,4cyclictest8010-21kworker/0:010:12:110
3206199192,9cyclictest24394-21kworker/0:008:05:150
3206199191,11cyclictest0-21swapper/008:30:180
3207999184,7cyclictest0-21swapper/307:16:223
3207999184,3cyclictest0-21swapper/311:05:183
3207999181,9cyclictest0-21swapper/311:45:233
32079991813,3cyclictest20706-21hddtemp_smartct11:35:163
3207399181,7cyclictest0-21swapper/210:51:592
3207399181,7cyclictest0-21swapper/209:21:532
32073991814,3cyclictest19873-21ntp_states09:05:232
3207399180,11cyclictest0-21swapper/208:54:132
3206999181,8cyclictest0-21swapper/112:21:331
3206999181,16cyclictest0-21swapper/110:40:031
3206199184,3cyclictest32058-21kworker/0:310:56:470
32061991812,4cyclictest10000-21df12:25:130
3207999175,3cyclictest87650irq/129-enp1s0-09:15:143
3207399175,3cyclictest12050irq/123-ahci[0009:15:012
3207399174,3cyclictest87350irq/126-enp1s0-09:15:202
3207399173,3cyclictest11660-21sshd08:46:132
3207399173,12cyclictest9994-21grep07:30:162
3207399171,7cyclictest5943-21df08:35:132
3207399171,7cyclictest18175-21/usr/sbin/munin07:50:192
32073991712,3cyclictest12907-21cat07:35:242
3207399171,15cyclictest0-21swapper/210:37:532
32073991711,4cyclictest18189-21diskstats11:30:162
32073991711,3cyclictest827-21runrttasks11:42:292
3207399170,10cyclictest0-21swapper/209:55:372
3206999170,15cyclictest0-21swapper/107:10:171
3207399161,9cyclictest0-21swapper/211:55:242
3207399161,6cyclictest22569-21/usr/sbin/munin08:00:212
3207399161,5cyclictest21705-21ls10:25:142
3207399161,14cyclictest0-21swapper/208:14:262
32073991611,3cyclictest9284-21sed07:30:012
32073991611,3cyclictest20033-21/usr/sbin/munin11:35:272
3207399151,11cyclictest0-21swapper/207:21:562
32073991510,3cyclictest24779-21/usr/sbin/munin08:05:252
32073991510,3cyclictest11426-21interrupts10:00:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional