You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 16:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Sat Jun 20, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
209812242165,24sleep20-21swapper/207:07:452
209812242165,24sleep20-21swapper/207:07:452
210692240165,24sleep30-21swapper/307:08:543
210692240165,24sleep30-21swapper/307:08:533
209312238160,24sleep00-21swapper/007:07:060
209312238160,24sleep00-21swapper/007:07:050
208092203168,23sleep10-21swapper/107:05:301
208092203168,23sleep10-21swapper/107:05:301
275921780,3sleep12124999cyclictest08:50:251
2765721620,5sleep22125499cyclictest12:15:182
272132970,5sleep22125499cyclictest07:20:152
21254995856,1cyclictest0-21swapper/209:39:302
91002470,1sleep20-21swapper/209:05:222
185002410,4sleep011-21rcuc/008:15:110
250692390,1sleep10-21swapper/112:10:151
21254993935,3cyclictest0-21swapper/211:23:572
104202360,7sleep232-21ksoftirqd/209:10:122
2124299357,13cyclictest752-21perf12:30:010
2125999331,14cyclictest0-21swapper/312:23:163
2124299338,12cyclictest30374-21perf11:10:020
2125999321,12cyclictest0-21swapper/311:07:593
21259993018,3cyclictest495-21jbd2/dm-0-807:55:223
2124299305,12cyclictest0-21swapper/012:20:010
2125999291,12cyclictest0-21swapper/311:44:303
2125999291,12cyclictest0-21swapper/310:25:473
2125999291,11cyclictest0-21swapper/309:33:563
2125999291,11cyclictest0-21swapper/309:33:563
2125999290,12cyclictest0-21swapper/312:28:153
2125999281,9cyclictest0-21swapper/311:25:143
2125999281,12cyclictest0-21swapper/307:40:323
2125999281,10cyclictest0-21swapper/308:55:213
2125999281,10cyclictest0-21swapper/308:43:413
2125999280,2cyclictest0-21swapper/309:50:383
2125999280,13cyclictest0-21swapper/311:59:323
2125999280,12cyclictest0-21swapper/311:33:103
2125999271,11cyclictest0-21swapper/312:13:083
2125999271,11cyclictest0-21swapper/308:30:173
21249992712,4cyclictest25904-21df_inode09:45:121
2124999271,12cyclictest0-21swapper/111:47:261
2124999271,10cyclictest19956-21sed09:30:221
2124999271,10cyclictest19956-21sed09:30:221
2125999261,13cyclictest0-21swapper/308:17:273
2125999261,11cyclictest0-21swapper/312:37:563
2125999261,11cyclictest0-21swapper/312:32:523
2125999261,10cyclictest16476-21cut11:50:163
2125999261,10cyclictest16476-21cut11:50:163
2125999260,24cyclictest0-21swapper/310:21:453
2125999260,11cyclictest0-21swapper/308:02:093
2124999269,3cyclictest29500-21chrt09:52:091
2124999265,11cyclictest0-21swapper/111:29:481
2124999264,9cyclictest17015-40dnf10:38:181
2125999257,3cyclictest0-21swapper/310:15:033
2125999251,9cyclictest0-21swapper/311:21:103
2125999251,9cyclictest0-21swapper/311:19:533
2125999251,7cyclictest0-21swapper/311:39:143
2125999251,11cyclictest0-21swapper/307:36:543
2125999251,10cyclictest0-21swapper/309:26:383
2125999251,10cyclictest0-21swapper/309:26:383
2125999250,9cyclictest0-21swapper/311:03:273
2125999250,9cyclictest0-21swapper/310:50:153
2125999250,12cyclictest0-21swapper/311:47:043
2124999259,4cyclictest1317-21memory11:15:181
2124999252,20cyclictest29348-21df_inode12:20:141
2124999252,11cyclictest0-21swapper/111:21:481
2124999250,5cyclictest0-21swapper/110:20:541
2124999250,19cyclictest0-21swapper/109:13:171
141182250,1sleep10-21swapper/110:30:221
116062250,7sleep232-21ksoftirqd/211:40:142
2125999248,8cyclictest0-21swapper/307:30:543
2125999241,9cyclictest0-21swapper/310:10:073
2125999241,14cyclictest24061-21cpu07:15:033
2125999241,14cyclictest0-21swapper/311:10:233
2125999240,9cyclictest0-21swapper/310:37:313
2125999240,8cyclictest0-21swapper/309:57:403
2125999240,16cyclictest0-21swapper/308:05:233
2125499246,6cyclictest10298-21sshd07:55:172
2125499241,13cyclictest0-21swapper/212:34:562
2124999247,6cyclictest22086-21memory09:35:191
2124999242,11cyclictest30869-21cat11:10:131
2124999241,20cyclictest8945-21users07:50:261
2124999241,14cyclictest0-21swapper/111:54:361
2124999241,14cyclictest0-21swapper/111:54:361
2124999241,10cyclictest19647-21grep10:45:111
21249992410,11cyclictest5485-21expr07:45:141
2124999240,6cyclictest0-21swapper/112:27:591
21242992417,5cyclictest27212-21smartctl07:20:160
2125999231,6cyclictest0-21swapper/312:03:513
2125999231,12cyclictest0-21swapper/309:17:433
2125999231,10cyclictest0-21swapper/310:34:473
2125999230,8cyclictest0-21swapper/307:50:323
2125999230,11cyclictest0-21swapper/310:46:253
2125499231,6cyclictest0-21swapper/212:37:312
2125499231,13cyclictest0-21swapper/209:52:572
2124999231,4cyclictest24269-21sed08:25:281
2124999231,11cyclictest0-21swapper/111:05:501
2124999230,14cyclictest0-21swapper/110:44:251
2124999230,14cyclictest0-21swapper/110:44:251
2125999221,9cyclictest9946-21diskmemload09:23:133
21259992215,4cyclictest28095-21grep07:20:263
2125999221,11cyclictest0-21swapper/307:45:173
2125499222,13cyclictest88950irq/132-enp2s0-07:32:342
2125499221,6cyclictest0-21swapper/212:21:112
2125499221,6cyclictest0-21swapper/212:11:512
2125499221,6cyclictest0-21swapper/211:11:142
2125499221,5cyclictest0-21swapper/209:55:132
2125499221,4cyclictest0-21swapper/211:39:032
2124999228,2cyclictest0-21swapper/110:20:011
2124999225,7cyclictest0-21swapper/111:38:241
2124999221,11cyclictest26309-21munin-run07:20:011
2124999221,10cyclictest8990-21perf11:35:011
2124999220,8cyclictest0-21swapper/112:08:491
2124999220,6cyclictest0-21swapper/109:44:401
2124999220,4cyclictest0-21swapper/110:04:561
2124299225,9cyclictest0-21swapper/010:05:410
2124299223,16cyclictest0-21swapper/008:10:000
2124299221,3cyclictest0-21swapper/011:47:300
2124299221,10cyclictest22421-21/usr/sbin/munin12:05:240
21242992210,3cyclictest825-21ntp_states10:00:220
62852211,2sleep00-21swapper/009:00:160
229422210,4sleep339-21rcuc/307:10:263
2125999211,4cyclictest0-21swapper/310:01:543
2125999211,13cyclictest0-21swapper/309:05:393
2125999211,13cyclictest0-21swapper/309:00:033
2125999211,11cyclictest0-21swapper/309:10:153
2125999210,9cyclictest0-21swapper/309:41:283
2125999210,9cyclictest0-21swapper/308:35:153
2125499214,9cyclictest17342-21tail11:50:272
2125499214,9cyclictest17342-21tail11:50:272
2125499211,3cyclictest23961-21unixbench_singl12:05:282
2125499211,12cyclictest0-21swapper/208:32:172
2125499211,11cyclictest5017-21irqstats10:10:192
2125499211,11cyclictest0-21swapper/211:17:202
2125499211,10cyclictest0-21swapper/209:43:332
2125499210,6cyclictest21528-21kworker/u8:110:55:242
2124999213,6cyclictest0-21swapper/110:51:501
2124999212,17cyclictest0-21swapper/110:11:431
2124999211,3cyclictest384-21seq07:34:391
2124999211,2cyclictest18283-21cat08:15:011
2124999211,18cyclictest0-21swapper/108:55:221
2124999211,18cyclictest0-21swapper/107:37:451
2124999211,17cyclictest25250-21smart_sda10:55:241
2124999210,7cyclictest17262-21fschecks_time09:25:161
2124999210,7cyclictest17262-21fschecks_time09:25:161
2124999210,7cyclictest0-21swapper/111:55:521
2124999210,6cyclictest0-21swapper/111:43:011
2124999210,13cyclictest0-21swapper/109:55:491
2124299214,7cyclictest0-21swapper/011:59:220
2124299212,10cyclictest18461-21ntp_states10:40:210
2124299212,10cyclictest18461-21ntp_states10:40:210
2124299211,6cyclictest0-21swapper/010:55:220
2124299211,4cyclictest16264-21open_files10:35:230
2124299211,4cyclictest0-21swapper/009:16:050
2124299211,2cyclictest87550irq/128-enp1s0-11:34:410
21242992111,2cyclictest20529-21head09:30:280
21242992111,2cyclictest20529-21head09:30:280
2124299211,11cyclictest3239-21/usr/sbin/munin12:35:210
2124299211,11cyclictest29004-21/usr/sbin/munin12:20:190
275502201,16sleep227745-21grep11:00:252
2125999206,3cyclictest0-21swapper/312:16:493
2125999206,2cyclictest0-21swapper/309:46:203
2125999204,3cyclictest0-21swapper/308:53:373
2125999201,2cyclictest0-21swapper/312:09:543
2125999201,12cyclictest0-21swapper/310:44:033
2125999201,12cyclictest0-21swapper/310:44:033
2125499209,3cyclictest20885-21taskset09:34:312
2125499209,3cyclictest20885-21taskset09:34:312
2125499204,9cyclictest0-21swapper/210:08:482
2125499203,9cyclictest827-21runrttasks11:25:272
2125499203,8cyclictest0-21swapper/210:53:002
2125499202,9cyclictest0-21swapper/211:47:072
2125499202,9cyclictest0-21swapper/211:06:032
2125499202,11cyclictest12056-21sensors10:25:262
2125499201,4cyclictest0-21swapper/209:29:152
2125499201,4cyclictest0-21swapper/209:29:152
2125499201,3cyclictest0-21swapper/209:24:522
2125499201,13cyclictest0-21swapper/209:17:192
2125499201,11cyclictest18004-21/usr/sbin/munin11:55:192
2125499201,10cyclictest13665-21hddtemp_smartct10:30:162
2124999209,3cyclictest10081-21cat09:10:011
2124999208,11cyclictest23-21ksoftirqd/108:15:251
2124999206,3cyclictest3731-21fschecks_time12:35:161
2124999206,12cyclictest20812-21kworker/u8:007:29:481
2124999202,16cyclictest0-21swapper/108:30:181
2124999202,16cyclictest0-21swapper/108:21:291
2124999202,16cyclictest0-21swapper/108:21:291
2124999202,16cyclictest0-21swapper/108:06:311
2124999201,17cyclictest0-21swapper/107:55:281
2124999201,11cyclictest21391-21processes12:00:221
2124999201,11cyclictest0-21swapper/110:25:131
2124999200,6cyclictest0-21swapper/111:02:561
2124999200,6cyclictest0-21swapper/109:17:231
2124299205,3cyclictest87550irq/128-enp1s0-09:35:160
2124299201,8cyclictest0-21swapper/011:10:550
2124299201,7cyclictest0-21swapper/011:40:240
2124299201,4cyclictest6527-21tr10:15:120
2124299201,4cyclictest0-21swapper/012:13:190
2124299201,3cyclictest0-21swapper/009:25:230
2124299201,3cyclictest0-21swapper/009:25:230
2124299201,11cyclictest11482-21hwlatdetect10:25:170
2124299201,10cyclictest808-21snmpd07:37:340
2124299200,9cyclictest7-21ksoftirqd/010:14:210
2125999199,3cyclictest0-21swapper/310:55:243
2125999191,3cyclictest0-21swapper/310:07:073
2125999191,12cyclictest0-21swapper/308:22:393
2125999191,12cyclictest0-21swapper/308:22:393
2125999191,12cyclictest0-21swapper/308:14:233
2125999191,10cyclictest31539-21/usr/sbin/munin08:45:253
2125999191,10cyclictest0-21swapper/309:39:463
2125999191,10cyclictest0-21swapper/308:27:313
2125499195,7cyclictest0-21swapper/212:01:572
2125499194,3cyclictest87650irq/129-enp1s0-08:20:252
2125499194,3cyclictest87650irq/129-enp1s0-08:20:252
2125499193,10cyclictest808-21snmpd07:36:242
2125499192,4cyclictest8564-1kworker/u9:110:41:232
2125499192,4cyclictest8564-1kworker/u9:110:41:232
2125499191,5cyclictest1294-21grep10:00:272
2125499191,11cyclictest0-21swapper/210:17:512
21254991910,2cyclictest87550irq/128-enp1s0-10:47:042
2124999197,5cyclictest23-21ksoftirqd/108:40:141
2124999192,16cyclictest0-21swapper/109:20:081
2124999192,16cyclictest0-21swapper/108:05:011
2124999192,16cyclictest0-21swapper/107:24:381
2124999192,16cyclictest0-21swapper/107:12:221
2124999191,2cyclictest3644-21smartctl07:40:171
2124999191,16cyclictest0-21swapper/112:15:361
2124999190,2cyclictest87550irq/128-enp1s0-12:31:131
2124999190,18cyclictest0-21swapper/109:04:241
2124299195,9cyclictest0-21swapper/008:59:570
2124299194,7cyclictest27147-21/usr/sbin/munin08:35:140
2124299191,6cyclictest2957-21seq11:20:130
2124299191,6cyclictest0-21swapper/011:37:100
2124299191,5cyclictest24862-21unixbench_multi09:40:270
2124299191,5cyclictest0-21swapper/009:46:370
2124299191,4cyclictest0-21swapper/012:32:560
2124299191,4cyclictest0-21swapper/010:53:210
21242991914,3cyclictest30611-21sed09:55:160
2124299191,3cyclictest0-21swapper/007:54:390
2124299191,11cyclictest0-21swapper/011:15:490
2124299191,10cyclictest0-21swapper/010:45:160
309912181,3sleep00-21swapper/008:41:020
2125499183,7cyclictest87650irq/129-enp1s0-08:10:172
2125499183,3cyclictest87350irq/126-enp1s0-10:20:192
2125499182,5cyclictest9327-21munin-run07:55:012
2125499181,6cyclictest1126-21latency_hist08:50:022
2125499181,5cyclictest21445-21/usr/sbin/munin07:10:212
2125499181,5cyclictest0-21swapper/210:35:252
2125499181,4cyclictest0-21swapper/209:45:062
2125499181,3cyclictest0-21swapper/212:27:242
21254991812,3cyclictest7354-21sh11:30:142
2124999181,16cyclictest0-21swapper/108:36:301
2124999181,15cyclictest0-21swapper/110:05:071
2124999181,14cyclictest31659-21grep08:45:121
2124299187,2cyclictest15561-21strings09:20:190
2124299185,3cyclictest2675-21cat08:50:240
2124299184,3cyclictest87550irq/128-enp1s0-09:10:010
2124299181,9cyclictest0-21swapper/009:10:260
2124299181,8cyclictest0-21swapper/010:31:080
2124299181,7cyclictest0-21swapper/011:51:180
2124299181,7cyclictest0-21swapper/011:51:180
2124299181,7cyclictest0-21swapper/011:00:140
2124299181,6cyclictest21571-21timerandwakeup12:00:240
2124299181,5cyclictest9509-21/usr/sbin/munin10:20:180
2124299181,5cyclictest0-21swapper/007:27:150
2124299181,3cyclictest0-21swapper/008:11:520
2124299181,2cyclictest23226-21kworker/0:207:17:170
95402170,3sleep00-21swapper/007:55:030
65172170,2sleep00-21swapper/011:26:410
2125999171,2cyclictest0-21swapper/307:27:273
2125499176,3cyclictest12050irq/123-ahci[0009:00:012
2125499172,4cyclictest28507-21timerandwakeup08:35:262
2125499172,3cyclictest87650irq/129-enp1s0-07:15:192
2125499172,3cyclictest29343-21/usr/sbin/munin08:40:252
2125499171,7cyclictest28731-21/usr/sbin/munin07:25:252
2125499171,6cyclictest0-21swapper/207:40:202
21254991713,3cyclictest0-21swapper/207:45:342
21254991712,3cyclictest11752-21/usr/sbin/munin08:00:212
2124299179,2cyclictest0-21swapper/008:25:160
2124299176,3cyclictest87550irq/128-enp1s0-08:45:200
2124299171,7cyclictest6152-21grep07:45:200
2124299171,5cyclictest2962-21/usr/sbin/munin07:40:130
21242991712,3cyclictest22441-21head07:10:190
21242991711,4cyclictest31509-21grep07:30:160
2124299171,13cyclictest11752-21/usr/sbin/munin08:00:290
2125499169,4cyclictest18979-21grep08:15:162
2125499161,3cyclictest6766-21needreboot09:00:182
21254991612,3cyclictest0-21swapper/208:06:432
2125499161,10cyclictest0-21swapper/208:25:352
21254991610,3cyclictest2022-21grep08:50:152
2124299168,1cyclictest0-21swapper/008:30:100
2124299162,9cyclictest0-21swapper/008:20:130
2124299162,9cyclictest0-21swapper/008:20:130
2124299161,4cyclictest28577-21irqstats09:50:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional