You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-29 - 22:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Sat Aug 29, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67762234165,57sleep20-21swapper/207:08:182
65832234162,24sleep00-21swapper/007:05:470
68692203167,24sleep10-21swapper/107:09:301
66182202166,24sleep30-21swapper/307:06:143
1498321500,2sleep3701199cyclictest07:25:173
1133821490,4sleep1700099cyclictest10:55:271
3106721350,4sleep1700099cyclictest11:40:261
7007999895,2cyclictest0-21swapper/209:42:052
7007998178,2cyclictest0-21swapper/208:08:382
40842630,3sleep19-21rcu_preempt09:25:251
172062580,1sleep00-21swapper/007:30:140
192732530,5sleep019148-21/usr/sbin/munin12:30:130
289822520,1sleep10-21swapper/109:10:161
89862370,2sleep00-21swapper/009:40:010
89862370,2sleep00-21swapper/009:40:010
700799361,2cyclictest0-21swapper/211:33:252
700799361,13cyclictest0-21swapper/210:05:172
7007993532,2cyclictest0-21swapper/208:11:362
701199341,25cyclictest0-21swapper/308:09:053
700799341,24cyclictest0-21swapper/212:16:212
699499349,12cyclictest28690-21awk10:25:010
6994993410,12cyclictest0-21swapper/011:05:010
700799333,17cyclictest26641-40dnf07:50:252
699499339,11cyclictest19890-21munin-run10:05:010
701199321,24cyclictest0-21swapper/307:33:503
701199320,16cyclictest0-21swapper/312:25:093
700799321,18cyclictest0-21swapper/208:15:212
700799321,14cyclictest0-21swapper/212:23:452
701199311,3cyclictest0-21swapper/310:20:173
701199311,18cyclictest0-21swapper/311:04:333
700799315,11cyclictest22174-21fschecks_time08:55:152
700799311,16cyclictest0-21swapper/211:38:392
6994993112,16cyclictest18925-21munin-run12:30:020
305072310,1sleep00-21swapper/008:00:160
18642310,4sleep30-21swapper/310:35:223
701199301,21cyclictest0-21swapper/310:27:013
700799301,22cyclictest0-21swapper/210:16:452
700799301,13cyclictest0-21swapper/209:38:172
700799301,13cyclictest0-21swapper/209:38:172
700799300,20cyclictest0-21swapper/211:14:322
6994993011,16cyclictest23660-21munin-run09:00:010
701199291,18cyclictest0-21swapper/308:57:053
701199290,22cyclictest0-21swapper/311:26:053
6994992910,16cyclictest16111-21munin-run11:10:010
701199281,18cyclictest31431-21chrt11:44:263
701199281,13cyclictest7365-21ntp_states08:20:213
701199281,12cyclictest0-21swapper/312:12:453
701199281,12cyclictest0-21swapper/309:04:093
700799289,3cyclictest0-21swapper/209:18:502
700799281,12cyclictest0-21swapper/210:56:462
700799281,10cyclictest0-21swapper/208:20:292
701199271,10cyclictest28058-21diskmemload10:48:493
701199271,10cyclictest11704-21munin-run11:00:013
701199270,12cyclictest0-21swapper/312:10:013
700799271,8cyclictest0-21swapper/209:32:092
700799271,11cyclictest0-21swapper/210:11:092
700799271,10cyclictest0-21swapper/212:12:172
700799271,10cyclictest0-21swapper/211:59:372
700799271,10cyclictest0-21swapper/211:59:372
700799271,10cyclictest0-21swapper/211:50:572
700799271,10cyclictest0-21swapper/207:27:512
701199267,8cyclictest0-21swapper/307:50:133
701199263,9cyclictest0-21swapper/309:25:593
701199261,8cyclictest19072-21cstates07:35:143
701199261,12cyclictest0-21swapper/310:10:253
701199261,11cyclictest879-21gltestperf09:20:153
701199260,9cyclictest0-21swapper/308:50:453
701199260,10cyclictest0-21swapper/307:16:103
700799269,3cyclictest0-21swapper/208:04:292
700799261,9cyclictest0-21swapper/211:45:492
700799261,9cyclictest0-21swapper/210:53:172
700799261,11cyclictest0-21swapper/212:09:512
700799261,11cyclictest0-21swapper/209:04:212
700799261,11cyclictest0-21swapper/208:44:052
700799261,11cyclictest0-21swapper/208:36:292
700799261,11cyclictest0-21swapper/207:58:292
700799261,10cyclictest0-21swapper/209:23:342
700799261,10cyclictest0-21swapper/207:41:272
700799261,10cyclictest0-21swapper/207:15:252
700799260,11cyclictest0-21swapper/212:34:572
700099262,13cyclictest0-21swapper/110:52:111
131012261,3sleep013204-21memory07:20:200
701199256,9cyclictest87650irq/129-enp1s0-10:41:373
701199256,11cyclictest87350irq/126-enp1s0-09:37:143
701199256,11cyclictest87350irq/126-enp1s0-09:37:143
701199254,12cyclictest87650irq/129-enp1s0-12:18:333
701199252,8cyclictest15533-21cat12:20:173
701199251,8cyclictest0-21swapper/311:21:493
701199251,16cyclictest0-21swapper/311:12:373
701199251,12cyclictest0-21swapper/312:39:093
701199251,12cyclictest0-21swapper/310:00:053
701199251,11cyclictest0-21swapper/308:17:413
701199251,10cyclictest28058-21diskmemload09:18:213
701199250,9cyclictest0-21swapper/311:16:053
701199250,9cyclictest0-21swapper/310:07:453
701199250,12cyclictest0-21swapper/309:58:583
701199250,10cyclictest0-21swapper/311:52:303
700799259,9cyclictest0-21swapper/210:29:152
700799258,9cyclictest0-21swapper/211:42:512
700799251,9cyclictest0-21swapper/209:05:042
700799251,11cyclictest0-21swapper/209:47:252
700799251,11cyclictest0-21swapper/208:49:532
700799251,10cyclictest0-21swapper/211:00:122
700799251,10cyclictest0-21swapper/210:42:112
700799251,10cyclictest0-21swapper/210:01:532
700799251,10cyclictest0-21swapper/207:45:072
700799250,9cyclictest0-21swapper/210:39:052
700799250,10cyclictest0-21swapper/210:30:432
700099251,4cyclictest14577-21ntp_states09:50:221
699499252,11cyclictest10459-21idleruntime-cro08:30:020
699499252,11cyclictest10459-21idleruntime-cro08:30:020
701199244,11cyclictest0-21swapper/311:39:543
701199242,8cyclictest0-21swapper/307:55:213
701199241,9cyclictest0-21swapper/312:02:313
701199241,9cyclictest0-21swapper/311:32:013
701199241,8cyclictest0-21swapper/308:01:533
701199241,12cyclictest0-21swapper/308:25:213
701199241,12cyclictest0-21swapper/308:25:213
701199241,10cyclictest0-21swapper/311:09:093
701199241,10cyclictest0-21swapper/310:50:533
701199241,10cyclictest0-21swapper/307:46:473
701199241,10cyclictest0-21swapper/307:43:283
701199241,10cyclictest0-21swapper/307:12:253
701199241,10cyclictest0-21swapper/307:12:253
7011992410,3cyclictest0-21swapper/308:46:453
701199240,10cyclictest0-21swapper/309:42:463
701199240,10cyclictest0-21swapper/308:33:293
700799241,9cyclictest0-21swapper/209:27:542
700799241,11cyclictest0-21swapper/211:21:342
700799241,10cyclictest23263-21df11:25:142
700799241,10cyclictest0-21swapper/212:25:072
700799241,10cyclictest0-21swapper/208:28:532
700799241,10cyclictest0-21swapper/208:28:532
700799240,9cyclictest0-21swapper/209:54:532
700799240,10cyclictest0-21swapper/211:18:382
700099242,4cyclictest3872-21munin-run08:15:001
700099241,3cyclictest8931-21sed09:40:011
700099241,3cyclictest8931-21sed09:40:011
700099241,17cyclictest0-21swapper/110:36:451
699499246,15cyclictest31494-21munin-run11:45:010
207542240,4sleep011-21rcuc/010:05:170
111952240,2sleep10-21swapper/108:30:151
701199239,3cyclictest0-21swapper/308:11:113
701199237,4cyclictest0-21swapper/310:17:333
701199233,3cyclictest0-21swapper/309:14:493
701199233,3cyclictest0-21swapper/308:36:253
701199231,9cyclictest0-21swapper/309:07:073
701199231,10cyclictest0-21swapper/310:32:173
7011992310,3cyclictest15907-21irqstats08:40:193
701199230,8cyclictest0-21swapper/311:45:423
701199230,10cyclictest0-21swapper/311:56:333
701199230,10cyclictest0-21swapper/311:56:333
701199230,10cyclictest0-21swapper/309:49:463
700799236,3cyclictest0-21swapper/209:57:172
700799235,3cyclictest0-21swapper/207:12:522
700799235,3cyclictest0-21swapper/207:12:512
700799231,9cyclictest0-21swapper/211:06:482
700799231,9cyclictest0-21swapper/210:49:592
700799231,9cyclictest0-21swapper/208:31:032
700799231,8cyclictest0-21swapper/207:32:152
700799231,10cyclictest0-21swapper/208:54:412
700099232,15cyclictest0-21swapper/111:27:131
700099231,8cyclictest0-21swapper/112:19:091
700099231,3cyclictest13916-21munin-run11:05:011
700099231,16cyclictest0-21swapper/110:12:141
7000992310,4cyclictest27057-21users07:50:261
7000992310,3cyclictest18910-21idleruntime-cro12:30:011
317602230,10sleep07-21ksoftirqd/009:15:250
701199224,9cyclictest0-21swapper/307:22:243
701199222,7cyclictest0-21swapper/312:31:453
701199221,9cyclictest0-21swapper/309:52:523
701199221,9cyclictest0-21swapper/309:31:173
700799227,9cyclictest0-21swapper/209:11:242
700799225,3cyclictest0-21swapper/207:24:252
700799221,10cyclictest0-21swapper/212:00:292
700099223,5cyclictest0-21swapper/111:05:141
700099222,18cyclictest0-21swapper/108:15:501
700099222,15cyclictest0-21swapper/110:19:361
700099222,15cyclictest0-21swapper/109:55:351
700099222,11cyclictest18357-21ntp_states08:45:231
7000992214,3cyclictest0-21swapper/110:01:171
700099221,18cyclictest27154-21ntp_states09:05:211
700099221,16cyclictest0-21swapper/110:27:581
699499226,7cyclictest0-21swapper/010:56:430
699499221,10cyclictest0-21swapper/012:20:260
700099219,3cyclictest31854-21awk08:05:001
700099211,3cyclictest19316-21/usr/sbin/munin12:30:131
700099211,18cyclictest0-21swapper/112:06:181
700099211,15cyclictest0-21swapper/111:36:051
700099211,15cyclictest0-21swapper/109:30:541
700099210,16cyclictest0-21swapper/109:19:021
699499217,5cyclictest0-21swapper/011:32:370
699499216,3cyclictest0-21swapper/009:34:490
699499215,5cyclictest0-21swapper/011:50:120
699499212,2cyclictest0-21swapper/012:00:240
699499211,10cyclictest519-21smart_sda11:45:240
700799200,13cyclictest0-21swapper/210:21:572
700099202,16cyclictest0-21swapper/112:01:311
700099202,16cyclictest0-21swapper/107:48:441
700099202,10cyclictest24134-21cstates09:00:141
700099201,8cyclictest0-21swapper/109:21:581
7000992016,3cyclictest0-21swapper/111:57:531
7000992016,3cyclictest0-21swapper/111:57:531
7000992016,3cyclictest0-21swapper/107:17:361
700099201,3cyclictest0-21swapper/112:37:081
700099201,2cyclictest13354-21ntp_states07:20:221
7000992012,3cyclictest0-21swapper/110:40:441
7000992012,3cyclictest0-21swapper/110:30:161
700099201,16cyclictest6589-21sensors10:45:261
700099201,14cyclictest0-21swapper/111:16:431
700099201,14cyclictest0-21swapper/110:21:321
700099201,11cyclictest6982-21cyclictest12:24:501
700099201,11cyclictest20560-21ntp_states08:50:241
700099201,10cyclictest18299-21latency_hist11:15:021
700099200,14cyclictest0-21swapper/109:41:151
699499209,3cyclictest21345-21/usr/sbin/munin12:35:270
699499208,3cyclictest0-21swapper/011:55:170
699499208,3cyclictest0-21swapper/011:55:170
699499206,3cyclictest0-21swapper/008:46:100
699499203,6cyclictest26641-40dnf07:50:240
699499203,2cyclictest0-21swapper/010:43:070
699499201,8cyclictest790-21in:imjournal08:25:020
699499201,3cyclictest28385-21basename07:55:170
699499201,11cyclictest8142-21grep10:50:160
699499201,11cyclictest28283-21sshd09:10:080
699499201,11cyclictest22540-21sshd11:23:070
699499201,11cyclictest13515-21/usr/sbin/munin09:50:180
699499201,11cyclictest0-21swapper/010:32:420
699499201,11cyclictest0-21swapper/010:10:030
232762201,15sleep023556-21expr07:45:120
700799194,4cyclictest28058-21diskmemload12:38:532
700099192,3cyclictest0-21swapper/111:49:241
700099192,16cyclictest0-21swapper/108:27:391
700099192,16cyclictest0-21swapper/108:27:391
700099192,15cyclictest0-21swapper/107:11:191
700099192,15cyclictest0-21swapper/107:11:181
700099191,8cyclictest0-21swapper/109:49:161
7000991915,3cyclictest0-21swapper/108:44:351
7000991915,3cyclictest0-21swapper/107:27:501
700099191,14cyclictest0-21swapper/111:34:311
700099191,12cyclictest0-21swapper/111:51:241
700099191,11cyclictest0-21swapper/107:35:051
700099191,10cyclictest6286-21sshd08:20:081
700099191,10cyclictest18137-21taskset07:30:251
700099191,10cyclictest14066-21ps08:35:251
700099191,10cyclictest12531-21cat12:15:021
700099191,10cyclictest0-21swapper/110:05:181
700099190,18cyclictest0-21swapper/108:06:511
699499197,3cyclictest0-21swapper/012:11:190
699499195,6cyclictest0-21swapper/011:19:290
699499194,3cyclictest0-21swapper/009:48:130
699499191,9cyclictest0-21swapper/010:37:560
699499191,5cyclictest0-21swapper/010:15:350
699499191,11cyclictest12558-21/usr/sbin/munin12:15:200
699499191,11cyclictest0-21swapper/011:39:000
699499191,10cyclictest23888-21/usr/sbin/munin09:00:190
699499190,7cyclictest0-21swapper/009:40:370
286442191,3sleep10-21swapper/107:55:211
700799181,14cyclictest19198-21cstates07:35:132
700099181,16cyclictest0-21swapper/108:55:321
699499186,4cyclictest0-21swapper/009:55:340
699499186,3cyclictest87550irq/128-enp1s0-08:30:160
699499184,11cyclictest11-21rcuc/009:25:230
699499181,9cyclictest0-21swapper/011:11:550
699499181,4cyclictest8161-21/usr/sbin/munin12:05:170
699499181,3cyclictest0-21swapper/010:47:430
699499181,15cyclictest0-21swapper/008:16:180
699499181,10cyclictest22925-21/usr/sbin/munin11:25:140
699499180,3cyclictest87350irq/126-enp1s0-09:20:290
227412181,3sleep10-21swapper/107:41:201
7000991714,2cyclictest0-21swapper/111:21:231
699499171,9cyclictest808-21snmpd09:07:480
699499171,5cyclictest0-21swapper/010:29:020
699499171,3cyclictest21191-21cpuspeed_turbos07:40:130
6994991712,3cyclictest15516-21uniq08:40:160
699499171,14cyclictest0-21swapper/008:36:590
699499171,14cyclictest0-21swapper/007:37:230
699499171,13cyclictest9457-21grep07:15:020
210972171,2sleep00-21swapper/008:50:300
699499161,6cyclictest14483-21/usr/sbin/munin07:25:160
699499161,5cyclictest0-21swapper/008:10:200
699499159,3cyclictest8412-21uname07:10:220
699499159,3cyclictest8412-21uname07:10:220
699499151,5cyclictest32069-21/usr/sbin/munin08:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional