You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 18:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3s.osadl.org (updated Fri May 01, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
74422238163,24sleep30-21swapper/307:05:473
77162236162,24sleep20-21swapper/207:09:212
76372234162,59sleep00-21swapper/007:08:170
75762232163,55sleep10-21swapper/107:07:301
1629521410,4sleep2787299cyclictest08:40:132
7872996764,2cyclictest0-21swapper/207:58:352
53382490,1sleep10-21swapper/109:29:561
167082480,2sleep20-21swapper/212:20:212
143482480,2sleep10-21swapper/111:00:261
787299431,30cyclictest0-21swapper/207:19:512
787299391,27cyclictest5099-40dnf09:26:532
786199399,27cyclictest11010-21perf12:10:000
786199383,3cyclictest4421-21latency_hist11:55:020
786199372,31cyclictest2914-21tr08:10:120
7861993712,22cyclictest3383-21/usr/sbin/munin09:25:140
786199371,11cyclictest6564-21sshd11:59:560
786199371,10cyclictest1163-21/usr/sbin/munin09:20:180
786199368,13cyclictest20766-21perf10:05:010
786199362,4cyclictest0-21swapper/010:26:550
786199361,11cyclictest16677-21ntp_states12:20:200
786199361,11cyclictest0-21swapper/009:35:550
7861993610,23cyclictest13194-21munin-run12:15:010
787299353,29cyclictest0-21swapper/212:15:152
786199359,3cyclictest31530-21irqstats08:00:170
7861993512,20cyclictest15955-21/usr/sbin/munin08:40:220
7861993511,3cyclictest17541-21/usr/sbin/munin07:30:200
787899341,25cyclictest0-21swapper/312:10:313
787899341,24cyclictest0-21swapper/310:32:193
787899341,24cyclictest0-21swapper/310:01:233
787899341,11cyclictest0-21swapper/307:55:113
786199349,4cyclictest28180-21/usr/sbin/munin11:35:200
786199343,8cyclictest16984-21chrt07:25:550
786199341,7cyclictest28927-21diskmemload12:26:260
786199341,2cyclictest0-21swapper/010:20:500
786199341,11cyclictest10598-21/usr/sbin/munin10:55:240
787899331,13cyclictest0-21swapper/310:57:353
787899331,13cyclictest0-21swapper/308:20:393
787299330,19cyclictest0-21swapper/207:24:052
786199335,13cyclictest25771-21perf11:30:010
7861993310,3cyclictest8744-21hwlatdetect07:10:160
7861993310,3cyclictest21587-21/usr/sbin/munin11:20:210
787299321,12cyclictest0-21swapper/208:21:262
786199329,3cyclictest24131-21/usr/sbin/munin07:45:170
786199328,3cyclictest28524-21/usr/sbin/munin07:55:160
786199328,3cyclictest12709-21grep09:45:160
786199323,3cyclictest18087-21unixbench_multi09:55:240
786199321,5cyclictest26329-21/usr/sbin/munin07:50:140
786199321,2cyclictest0-21swapper/010:54:100
786199321,12cyclictest1805-21/usr/sbin/munin10:35:170
786199320,9cyclictest0-21swapper/008:30:130
787899319,2cyclictest0-21swapper/311:25:233
787899311,13cyclictest0-21swapper/309:48:153
787899311,13cyclictest0-21swapper/309:40:033
787899311,13cyclictest0-21swapper/308:42:283
787899311,13cyclictest0-21swapper/307:52:273
787899311,12cyclictest0-21swapper/309:20:313
787899310,13cyclictest0-21swapper/311:41:553
787299311,25cyclictest0-21swapper/207:34:332
787299311,21cyclictest0-21swapper/209:55:252
787299311,19cyclictest0-21swapper/208:16:482
787299310,13cyclictest0-21swapper/209:04:052
787299310,13cyclictest0-21swapper/209:04:052
786199319,4cyclictest32352-21dump-pmu-power11:45:010
786199319,3cyclictest7162-21/usr/sbin/munin08:20:180
786199318,3cyclictest26953-21/usr/sbin/munin09:05:150
786199317,3cyclictest7754-21/usr/sbin/munin12:00:190
786199315,5cyclictest0-21swapper/012:15:230
7861993111,17cyclictest22883-21df08:55:120
7861993111,17cyclictest10554-21gltestperf07:15:030
7861993110,3cyclictest1749-21processes08:05:230
787899301,19cyclictest0-21swapper/312:09:473
787899301,19cyclictest0-21swapper/310:53:193
787899301,13cyclictest0-21swapper/311:54:273
787899301,13cyclictest0-21swapper/309:33:593
787899301,13cyclictest0-21swapper/307:40:073
787899301,13cyclictest0-21swapper/307:31:513
787899301,12cyclictest0-21swapper/311:05:473
787899301,12cyclictest0-21swapper/309:55:313
787899301,12cyclictest0-21swapper/308:35:433
787899301,12cyclictest0-21swapper/308:10:593
787899301,11cyclictest0-21swapper/309:00:473
787899301,11cyclictest0-21swapper/309:00:473
787899300,13cyclictest0-21swapper/308:56:353
787299301,13cyclictest5580-21/usr/sbin/munin09:30:252
787299301,10cyclictest0-21swapper/209:11:292
787299300,23cyclictest0-21swapper/211:06:412
787299300,23cyclictest0-21swapper/208:36:452
787299300,12cyclictest0-21swapper/209:07:212
786199309,4cyclictest21237-21/usr/sbin/munin12:30:220
786199308,3cyclictest827-21runrttasks11:14:310
786199308,3cyclictest14911-21latency_hist11:05:010
786199306,3cyclictest25979-21/usr/sbin/munin11:30:100
786199306,2cyclictest0-21swapper/008:25:160
786199305,4cyclictest21338-21strings08:50:190
786199303,5cyclictest0-21swapper/010:45:230
786199301,13cyclictest29148-21/usr/sbin/munin09:10:160
7861993011,16cyclictest23801-21grep10:10:150
7861993010,3cyclictest4907-21load10:40:170
7861993010,3cyclictest20977-21/usr/sbin/munin10:05:120
787899291,13cyclictest0-21swapper/312:25:073
787899291,13cyclictest0-21swapper/312:21:153
787899291,13cyclictest0-21swapper/310:28:033
787899291,13cyclictest0-21swapper/307:37:593
787899291,12cyclictest0-21swapper/311:36:073
787899291,12cyclictest0-21swapper/311:02:233
787899291,12cyclictest0-21swapper/309:38:153
787899291,11cyclictest0-21swapper/312:15:393
787899291,11cyclictest0-21swapper/308:06:153
787899291,11cyclictest0-21swapper/308:01:353
787899291,11cyclictest0-21swapper/307:29:313
787899290,12cyclictest0-21swapper/310:42:233
787299291,11cyclictest0-21swapper/208:46:372
787299291,11cyclictest0-21swapper/207:44:132
787299290,19cyclictest0-21swapper/210:15:132
787299290,12cyclictest0-21swapper/210:12:092
786199299,3cyclictest827-21runrttasks08:49:120
786199298,4cyclictest0-21swapper/008:15:140
786199295,5cyclictest0-21swapper/007:21:520
786199291,9cyclictest0-21swapper/010:34:060
786199291,5cyclictest7183-21taskset09:30:260
786199291,5cyclictest0-21swapper/009:15:450
7861992912,3cyclictest10929-21wc09:40:190
786199291,12cyclictest21683-21sshd07:39:510
787899281,15cyclictest7023-21grep10:45:173
7878992811,3cyclictest0-21swapper/311:15:153
787899281,13cyclictest0-21swapper/307:19:273
787899281,12cyclictest0-21swapper/312:34:193
787899281,12cyclictest0-21swapper/311:31:233
787899281,12cyclictest0-21swapper/308:34:313
787899281,11cyclictest0-21swapper/311:49:073
787899281,10cyclictest0-21swapper/310:37:513
7878992810,3cyclictest0-21swapper/307:11:433
787899280,13cyclictest0-21swapper/308:19:473
787299281,22cyclictest0-21swapper/211:38:252
787299281,11cyclictest0-21swapper/212:13:452
787299281,11cyclictest0-21swapper/210:22:012
787299280,12cyclictest0-21swapper/211:25:292
787299280,11cyclictest0-21swapper/212:37:152
787299280,11cyclictest0-21swapper/212:37:152
786199289,3cyclictest23608-21wc12:35:230
786199289,3cyclictest23608-21wc12:35:230
786199289,3cyclictest21357-21latency_hist11:20:010
786199288,3cyclictest87550irq/128-enp1s0-11:45:130
786199286,3cyclictest0-21swapper/011:05:190
786199281,8cyclictest0-21swapper/009:50:140
787899271,9cyclictest0-21swapper/307:47:353
787899271,14cyclictest0-21swapper/311:10:233
787899271,14cyclictest0-21swapper/310:11:433
787899271,13cyclictest0-21swapper/311:56:473
787899271,11cyclictest0-21swapper/309:28:393
787899271,10cyclictest0-21swapper/309:13:233
787899271,10cyclictest0-21swapper/308:52:363
7878992710,4cyclictest26630-21sensors_temp10:15:233
787899270,14cyclictest0-21swapper/308:46:443
787899270,13cyclictest0-21swapper/309:18:113
787299271,9cyclictest0-21swapper/207:52:492
787299271,13cyclictest0-21swapper/211:57:192
787299271,13cyclictest0-21swapper/211:51:532
787299271,13cyclictest0-21swapper/208:06:572
787299271,12cyclictest0-21swapper/207:12:012
787299271,11cyclictest19828-21fschecks_count11:15:152
787299271,11cyclictest0-21swapper/210:46:542
787299271,11cyclictest0-21swapper/210:40:182
787299271,11cyclictest0-21swapper/209:21:512
787299271,11cyclictest0-21swapper/208:02:012
787299271,10cyclictest0-21swapper/208:31:252
787299271,10cyclictest0-21swapper/208:13:542
787299270,12cyclictest0-21swapper/212:07:172
787299270,10cyclictest0-21swapper/210:06:052
786199277,2cyclictest13891-21cpuspeed_turbos08:35:120
786199272,6cyclictest26434-21ntp_states10:15:210
787899261,9cyclictest0-21swapper/312:36:233
787899261,9cyclictest0-21swapper/312:36:233
787899261,12cyclictest0-21swapper/307:20:073
787899261,10cyclictest0-21swapper/311:24:003
7878992610,3cyclictest0-21swapper/309:52:033
787899260,12cyclictest0-21swapper/310:22:593
787299261,11cyclictest808-21snmpd07:28:592
787299261,10cyclictest0-21swapper/208:58:092
787299260,16cyclictest0-21swapper/210:25:272
787299260,13cyclictest0-21swapper/210:50:462
787299260,11cyclictest0-21swapper/211:03:372
787299260,11cyclictest0-21swapper/208:25:132
787299260,10cyclictest0-21swapper/209:50:012
787899259,3cyclictest0-21swapper/310:06:193
787899258,3cyclictest0-21swapper/312:04:273
787299251,8cyclictest0-21swapper/209:46:532
787299251,12cyclictest28927-21diskmemload12:03:292
787299251,10cyclictest0-21swapper/207:45:372
787299251,10cyclictest0-21swapper/207:36:072
787299250,13cyclictest0-21swapper/209:44:092
787299250,12cyclictest0-21swapper/212:32:552
787299250,12cyclictest0-21swapper/211:14:412
787299250,12cyclictest0-21swapper/210:31:212
787299250,11cyclictest0-21swapper/209:15:392
787899248,3cyclictest0-21swapper/308:27:593
787299241,11cyclictest0-21swapper/211:46:492
787299241,11cyclictest0-21swapper/208:51:172
7872992410,3cyclictest0-21swapper/212:25:092
787299240,11cyclictest0-21swapper/210:58:382
787299240,10cyclictest0-21swapper/211:31:132
7865992415,3cyclictest0-21swapper/107:30:331
786199248,3cyclictest24926-21cstates09:00:130
786199248,3cyclictest24926-21cstates09:00:130
786199243,7cyclictest0-21swapper/007:40:120
787899239,3cyclictest0-21swapper/309:07:113
787299236,3cyclictest0-21swapper/211:22:012
787299231,11cyclictest0-21swapper/210:39:522
787299231,10cyclictest0-21swapper/210:03:092
787299230,11cyclictest0-21swapper/209:37:192
787299230,10cyclictest0-21swapper/211:40:172
786599232,15cyclictest0-21swapper/108:40:491
786599231,3cyclictest28871-21diskstats07:55:121
786599231,19cyclictest6485-21cstates10:45:121
786599229,4cyclictest5292-21hddtemp_smartct11:55:151
786599222,18cyclictest0-21swapper/112:15:541
786599222,15cyclictest0-21swapper/108:20:531
786599222,15cyclictest0-21swapper/107:29:551
7865992214,3cyclictest0-21swapper/107:52:531
786599221,16cyclictest0-21swapper/108:38:301
786599221,16cyclictest0-21swapper/108:11:341
786599221,12cyclictest0-21swapper/111:30:581
786599220,6cyclictest0-21swapper/110:55:581
786599219,11cyclictest2709-21kworker/u8:209:02:231
786599219,11cyclictest2709-21kworker/u8:209:02:231
786599217,6cyclictest0-21swapper/111:52:291
786599212,17cyclictest0-21swapper/109:47:301
786599212,15cyclictest0-21swapper/108:45:411
7865992117,3cyclictest0-21swapper/107:15:041
786599211,3cyclictest0-21swapper/109:05:231
7865992113,3cyclictest0-21swapper/108:56:541
7865992113,3cyclictest0-21swapper/108:33:401
786599211,15cyclictest0-21swapper/108:19:301
786599211,11cyclictest23801-21/usr/sbin/munin11:25:101
786599210,16cyclictest0-21swapper/107:48:011
786599210,15cyclictest0-21swapper/107:35:041
786599210,13cyclictest0-21swapper/109:16:521
259542210,1sleep10-21swapper/110:15:161
786599203,4cyclictest0-21swapper/110:20:231
786599202,3cyclictest0-21swapper/108:07:011
786599201,8cyclictest22308-21basename11:20:161
7865992016,3cyclictest0-21swapper/112:31:201
7865992016,3cyclictest0-21swapper/111:42:421
7865992016,3cyclictest0-21swapper/111:05:361
7865992013,3cyclictest0-21swapper/111:45:221
7865992013,2cyclictest0-21swapper/107:23:501
786599201,2cyclictest0-21swapper/108:02:351
786599201,14cyclictest0-21swapper/109:22:051
786599201,14cyclictest0-21swapper/108:50:501
786599201,11cyclictest29970-21cat10:25:121
786599201,11cyclictest10370-21latency_hist10:55:021
786599201,10cyclictest21262-21cat10:05:131
7865992010,2cyclictest30399-21/usr/sbin/munin09:10:221
786599200,14cyclictest0-21swapper/108:25:131
786599198,3cyclictest17172-21grep12:20:251
786599192,16cyclictest0-21swapper/112:39:031
786599192,16cyclictest0-21swapper/112:39:021
786599192,16cyclictest0-21swapper/110:38:271
786599191,2cyclictest0-21swapper/109:40:171
7865991912,2cyclictest0-21swapper/107:13:451
786599191,17cyclictest0-21swapper/112:02:061
786599191,17cyclictest0-21swapper/111:39:181
786599191,17cyclictest0-21swapper/110:14:131
786599191,16cyclictest0-21swapper/110:31:141
786599191,10cyclictest7749-21cat09:35:021
786599191,10cyclictest10202-21ps12:05:231
786599191,10cyclictest0-21swapper/112:26:271
786599191,10cyclictest0-21swapper/110:40:221
786599190,5cyclictest0-21swapper/112:12:041
786599182,2cyclictest87650irq/129-enp1s0-09:50:111
786599181,9cyclictest0-21swapper/111:10:411
7865991814,3cyclictest0-21swapper/109:37:511
786599181,3cyclictest20356-21users10:00:251
786599181,2cyclictest0-21swapper/107:42:431
786599181,15cyclictest20901-21sed11:15:261
786599181,15cyclictest0-21swapper/109:56:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional