You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-01 - 21:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot3s.osadl.org (updated Tue Sep 01, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
101742240165,22sleep30-21swapper/307:09:433
99892229159,57sleep20-21swapper/207:07:212
99682224195,19sleep10-21swapper/107:07:051
98902202165,25sleep00-21swapper/007:06:020
10295998178,2cyclictest0-21swapper/212:32:262
311542560,4sleep11028999cyclictest11:35:171
207052530,3sleep081ktimersoftd/011:10:240
51722450,1sleep10-21swapper/111:50:131
1028999361,25cyclictest0-21swapper/108:14:121
1029999352,11cyclictest11462-21/usr/sbin/munin12:05:253
1028999351,28cyclictest0-21swapper/112:31:201
10282993510,13cyclictest24429-21idleruntime-cro12:35:010
1029999342,11cyclictest1553-21/usr/sbin/munin11:40:243
1029999341,25cyclictest0-21swapper/309:47:203
1029999340,6cyclictest8564-1kworker/u9:110:11:303
1028999341,25cyclictest0-21swapper/111:17:061
1028999341,24cyclictest0-21swapper/107:59:541
1028999341,11cyclictest0-21swapper/111:57:241
178562330,2sleep10-21swapper/109:50:211
10295993330,2cyclictest0-21swapper/211:37:442
1028999331,24cyclictest0-21swapper/110:50:381
1028299339,11cyclictest26001-21munin-run11:25:010
1029999321,25cyclictest0-21swapper/308:43:293
1029999321,24cyclictest0-21swapper/310:32:453
1029999321,23cyclictest0-21swapper/311:34:363
1029999321,15cyclictest0-21swapper/310:23:163
1029999321,14cyclictest0-21swapper/310:25:083
1028999321,23cyclictest0-21swapper/108:37:161
1028999320,24cyclictest0-21swapper/108:27:021
10299993115,3cyclictest10861-21cpu10:50:123
1029999311,16cyclictest0-21swapper/312:35:433
1029999311,15cyclictest0-21swapper/309:15:323
1029999311,13cyclictest14528-21grep10:55:273
1029999311,12cyclictest27899-21grep07:45:263
1029999310,23cyclictest0-21swapper/311:26:563
1029999310,16cyclictest0-21swapper/308:45:133
1029999310,16cyclictest0-21swapper/308:45:123
1029999310,12cyclictest0-21swapper/311:00:123
1028299318,11cyclictest31348-21diskmemload10:25:010
10299993013,4cyclictest21529-21grep07:30:263
1029999301,14cyclictest0-21swapper/309:36:243
1029999301,13cyclictest5529-21hddtemp_smartct11:50:163
1029999301,13cyclictest0-21swapper/308:35:053
1029999300,15cyclictest0-21swapper/312:04:123
1029999300,14cyclictest0-21swapper/309:28:283
1029999300,12cyclictest0-21swapper/309:55:123
1029999300,12cyclictest0-21swapper/309:55:123
1028999301,23cyclictest0-21swapper/110:47:261
1028999301,13cyclictest0-21swapper/107:27:491
1028999301,12cyclictest0-21swapper/107:32:431
1028299304,13cyclictest15626-21munin-run12:15:010
1029999291,19cyclictest0-21swapper/309:42:003
1029999291,15cyclictest0-21swapper/312:34:433
1029999291,15cyclictest0-21swapper/310:05:363
1029999291,14cyclictest0-21swapper/312:15:443
1029999291,14cyclictest0-21swapper/309:07:283
1029999291,13cyclictest0-21swapper/309:30:443
1029999291,13cyclictest0-21swapper/309:24:363
1029999291,13cyclictest0-21swapper/308:57:003
1029999291,13cyclictest0-21swapper/308:28:053
1029999291,13cyclictest0-21swapper/308:20:573
1029999291,12cyclictest0-21swapper/312:13:563
1029999291,11cyclictest0-21swapper/310:16:003
1029999290,14cyclictest0-21swapper/312:23:293
1029999290,14cyclictest0-21swapper/310:49:573
1029999290,13cyclictest0-21swapper/309:51:163
1028999291,25cyclictest0-21swapper/107:11:081
1028999291,12cyclictest0-21swapper/108:54:281
1029999281,19cyclictest0-21swapper/307:24:483
1029999280,12cyclictest0-21swapper/311:17:003
1028999281,13cyclictest0-21swapper/108:44:301
1028999281,11cyclictest1771-21needreboot08:00:201
1028999281,11cyclictest0-21swapper/111:26:171
1028999281,11cyclictest0-21swapper/108:15:321
1028999281,10cyclictest0-21swapper/107:46:481
1028999280,10cyclictest0-21swapper/108:09:401
308272270,4sleep230-21rcuc/210:20:162
253742270,4sleep2311ktimersoftd/210:10:022
1029999278,3cyclictest0-21swapper/311:35:083
10299992712,3cyclictest0-21swapper/309:00:563
1029999271,18cyclictest0-21swapper/309:13:043
1029999271,14cyclictest0-21swapper/311:09:403
1029999271,14cyclictest0-21swapper/311:09:403
1029999270,19cyclictest0-21swapper/308:02:203
1029999270,13cyclictest0-21swapper/312:26:483
1029999270,13cyclictest0-21swapper/311:21:083
1028999278,7cyclictest0-21swapper/112:07:581
1028999271,9cyclictest0-21swapper/107:16:581
1028999271,20cyclictest0-21swapper/108:59:401
1028999271,12cyclictest0-21swapper/110:30:461
1028999271,12cyclictest0-21swapper/109:32:531
1028999271,12cyclictest0-21swapper/109:06:361
1028999271,11cyclictest0-21swapper/110:28:301
1028999270,10cyclictest0-21swapper/109:40:071
1029999269,2cyclictest0-21swapper/307:40:203
1029999261,12cyclictest0-21swapper/308:34:133
1029999261,10cyclictest0-21swapper/308:54:443
1028999261,9cyclictest0-21swapper/110:02:441
1028999261,9cyclictest0-21swapper/108:49:501
1028999261,9cyclictest0-21swapper/108:49:501
1028999261,12cyclictest0-21swapper/110:21:581
1028999261,11cyclictest0-21swapper/112:00:281
1028999261,11cyclictest0-21swapper/111:22:271
1028999261,11cyclictest0-21swapper/110:41:141
1028999261,11cyclictest0-21swapper/108:22:381
1028999261,10cyclictest0-21swapper/112:20:321
1028999261,10cyclictest0-21swapper/107:52:341
1028999261,10cyclictest0-21swapper/107:22:281
1029999259,3cyclictest0-21swapper/311:57:563
1029999259,10cyclictest0-21swapper/307:36:363
1029999259,10cyclictest0-21swapper/307:36:363
1029999258,3cyclictest0-21swapper/307:16:403
1029999257,3cyclictest0-21swapper/308:09:573
10299992511,3cyclictest0-21swapper/307:55:403
1029999251,11cyclictest0-21swapper/307:27:203
1029999250,13cyclictest0-21swapper/311:45:323
1029999250,11cyclictest0-21swapper/311:13:163
1028999252,6cyclictest19561-21fschecks_time09:55:151
1028999252,6cyclictest19561-21fschecks_time09:55:151
1028999251,9cyclictest0-21swapper/111:11:481
1028999251,12cyclictest0-21swapper/112:35:421
1028999251,11cyclictest0-21swapper/111:41:191
1028999251,11cyclictest0-21swapper/110:38:541
1028999250,9cyclictest0-21swapper/109:15:361
1028999250,11cyclictest0-21swapper/112:26:221
1028999250,11cyclictest0-21swapper/111:07:341
1028999250,11cyclictest0-21swapper/111:07:341
1029999246,3cyclictest0-21swapper/307:12:013
10299992410,3cyclictest0-21swapper/310:02:363
1029599241,5cyclictest0-21swapper/211:48:112
1028999241,6cyclictest0-21swapper/112:11:141
1028999241,10cyclictest0-21swapper/111:03:421
1028999241,10cyclictest0-21swapper/109:14:481
1028999241,10cyclictest0-21swapper/109:01:041
10289992410,11cyclictest25388-21awk07:40:201
1028999240,9cyclictest0-21swapper/109:45:241
1028999240,12cyclictest0-21swapper/110:18:581
1028999240,10cyclictest0-21swapper/111:33:191
1028999240,10cyclictest0-21swapper/109:21:451
1029999239,3cyclictest0-21swapper/308:19:493
1029999239,2cyclictest0-21swapper/310:38:533
1029999237,3cyclictest6426-21/usr/sbin/munin10:40:253
1029999237,3cyclictest0-21swapper/307:52:323
1028999231,10cyclictest0-21swapper/109:38:311
1028999231,10cyclictest0-21swapper/108:30:421
1028999230,9cyclictest0-21swapper/112:15:481
1028999230,10cyclictest0-21swapper/111:45:141
1028999230,10cyclictest0-21swapper/110:55:361
1029999229,3cyclictest0-21swapper/308:10:413
1028999228,2cyclictest0-21swapper/107:35:471
1028999228,2cyclictest0-21swapper/107:35:461
1028999221,8cyclictest0-21swapper/110:08:181
1028999220,11cyclictest0-21swapper/110:14:441
1028299224,9cyclictest15595-21sshd08:30:280
130742210,4sleep011-21rcuc/008:25:240
1028299216,3cyclictest17231-21kworker/0:207:26:370
1028299214,15cyclictest14375-21idleruntime-cro09:45:010
1028299212,11cyclictest20577-21/usr/sbin/munin08:45:180
1028299212,11cyclictest20577-21/usr/sbin/munin08:45:180
1028299212,11cyclictest15573-21/usr/sbin/munin07:20:240
277542200,16sleep20-21swapper/209:00:152
1029599201,8cyclictest30752-21grep07:55:022
1029599201,7cyclictest3743-21tr09:20:132
1029599201,7cyclictest15524-21memory09:45:202
1029599201,5cyclictest0-21swapper/210:52:582
1028999203,7cyclictest0-21swapper/109:25:231
1028299203,9cyclictest0-21swapper/011:37:220
1028299203,6cyclictest18081-21systemd-journal12:20:100
1028299203,15cyclictest29772-21munin-run10:20:010
1028299201,6cyclictest0-21swapper/010:29:390
1028299201,5cyclictest0-21swapper/011:50:490
1028299201,11cyclictest31576-21/usr/sbin/munin09:10:150
1028299201,11cyclictest2656-21/usr/sbin/munin11:45:260
31372191,3sleep00-21swapper/009:16:580
197022191,2sleep231348-21diskmemload12:21:052
120202190,3sleep00-21swapper/009:38:050
1029599198,3cyclictest80792sed08:15:182
1029599193,4cyclictest25134-21sed11:20:222
10295991913,3cyclictest17154-21df_inode09:50:152
10295991913,3cyclictest1141-21grep08:00:152
10295991912,4cyclictest30386-21latency_hist11:35:022
10295991912,4cyclictest17444-21/usr/sbin/munin12:15:262
1029599191,11cyclictest0-21swapper/210:46:152
1029599191,10cyclictest0-21swapper/211:15:482
1029599190,7cyclictest495-21jbd2/dm-0-808:13:332
1028299197,11cyclictest0-21swapper/011:05:010
1028299194,5cyclictest909-21sssd_nss10:30:240
1028299191,9cyclictest25968-21needreboot08:55:210
1028299191,8cyclictest29093-21sh11:30:170
1028299191,6cyclictest0-21swapper/010:56:090
1028299191,6cyclictest0-21swapper/010:39:080
1028299191,5cyclictest7713-21ls10:40:240
1028299191,4cyclictest24819-21cat12:35:130
1028299191,3cyclictest0-21swapper/011:40:400
1028299191,2cyclictest16166-21grep09:45:270
10282991912,4cyclictest23399-21fgrep07:35:240
10282991912,4cyclictest23399-21fgrep07:35:240
1028299191,11cyclictest12166-21sshd07:11:280
1028299191,11cyclictest0-21swapper/007:15:280
1028299191,10cyclictest19972-21/usr/sbin/munin07:30:180
1028299191,10cyclictest0-21swapper/010:05:120
93352181,2sleep00-21swapper/008:19:520
88472181,2sleep031348-21diskmemload11:57:590
273362180,3sleep00-21swapper/010:12:090
111592181,2sleep00-21swapper/012:04:140
105582180,3sleep00-21swapper/010:49:370
1029599189,2cyclictest87550irq/128-enp1s0-10:36:432
1029599186,4cyclictest3413-21grep08:05:142
1029599184,3cyclictest0-21swapper/210:01:202
1029599181,8cyclictest0-21swapper/212:14:112
1029599181,8cyclictest0-21swapper/209:29:192
1029599181,7cyclictest32749-21ps09:10:222
1029599181,7cyclictest0-21swapper/211:58:212
1029599181,7cyclictest0-21swapper/209:59:042
1029599181,7cyclictest0-21swapper/209:59:032
1029599181,6cyclictest0-21swapper/212:00:402
1029599181,5cyclictest0-21swapper/211:10:182
1029599181,5cyclictest0-21swapper/207:57:302
10295991812,3cyclictest17256-21ntp_states08:35:242
1029599181,15cyclictest0-21swapper/208:47:582
1029599181,15cyclictest0-21swapper/208:47:582
1029599181,14cyclictest13259-21grep08:25:252
1029599181,11cyclictest0-21swapper/209:38:262
10295991810,5cyclictest0-21swapper/212:25:112
1028299188,3cyclictest18382-21/usr/sbin/munin08:40:250
1028299188,2cyclictest0-21swapper/008:00:200
1028299187,3cyclictest27173-21/usr/sbin/munin09:00:220
1028299187,2cyclictest25920-21head07:40:260
1028299185,3cyclictest87550irq/128-enp1s0-10:00:260
1028299181,8cyclictest0-21swapper/009:30:190
1028299181,6cyclictest7-21ksoftirqd/012:25:190
1028299181,6cyclictest0-21swapper/009:29:430
1028299181,5cyclictest31351-21munin-run09:10:020
1028299181,5cyclictest28535-21munin-run07:50:010
1028299181,4cyclictest17827-21perf12:20:010
10282991811,4cyclictest3581-21gltestperf08:05:150
52232170,2sleep00-21swapper/009:20:320
184542170,2sleep00-21swapper/009:51:020
113852171,2sleep00-21swapper/008:22:530
1029599175,3cyclictest15135-21sshd07:17:282
1029599172,8cyclictest0-21swapper/211:50:272
1029599172,8cyclictest0-21swapper/211:26:432
1029599172,2cyclictest87350irq/126-enp1s0-07:43:112
1029599171,8cyclictest0-21swapper/208:55:342
1029599171,6cyclictest2588-21ps09:15:232
1029599171,6cyclictest0-21swapper/211:00:072
1029599171,5cyclictest0-21swapper/210:28:262
1029599171,5cyclictest0-21swapper/208:30:372
1029599171,3cyclictest0-21swapper/207:21:352
10295991713,3cyclictest0-21swapper/207:10:122
10295991712,3cyclictest29381-21/usr/sbin/munin09:05:252
1029599171,15cyclictest0-21swapper/210:59:002
1029599171,15cyclictest0-21swapper/209:33:222
1029599171,15cyclictest0-21swapper/208:20:452
1029599171,10cyclictest0-21swapper/212:09:512
1029599171,10cyclictest0-21swapper/208:41:182
1029599171,10cyclictest0-21swapper/207:27:162
10295991710,4cyclictest26224-21grep10:10:172
10295991710,4cyclictest24164-21cat08:50:252
10295991710,4cyclictest0-21swapper/211:05:162
10295991710,4cyclictest0-21swapper/211:05:162
1028299179,2cyclictest0-21swapper/008:50:220
1028299172,3cyclictest87550irq/128-enp1s0-07:50:200
1028299171,9cyclictest808-21snmpd11:29:510
1028299171,7cyclictest0-21swapper/011:07:080
1028299171,7cyclictest0-21swapper/011:07:080
1028299171,6cyclictest0-21swapper/012:06:540
1028299171,6cyclictest0-21swapper/009:55:200
1028299171,6cyclictest0-21swapper/009:55:200
1028299171,3cyclictest31348-21diskmemload11:19:280
1028299171,14cyclictest0-21swapper/010:51:490
209992161,2sleep20-21swapper/207:30:212
1029599161,8cyclictest0-21swapper/210:40:182
1029599161,6cyclictest1124-21hostname11:40:182
1029599161,5cyclictest24982-21df_inode12:35:142
1029599161,3cyclictest0-21swapper/210:19:132
1029599161,3cyclictest0-21swapper/207:45:522
10295991611,3cyclictest13872-21unixbench-2d09:40:232
10295991610,4cyclictest3753-21seq10:31:582
10295991610,3cyclictest22167-21/usr/sbin/munin07:35:212
10295991610,3cyclictest22167-21/usr/sbin/munin07:35:212
1028299165,3cyclictest11-21rcuc/007:55:170
1028299161,12cyclictest16188-21/usr/sbin/munin08:35:150
10282991610,3cyclictest5851-21gltestperf08:10:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional