You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 05:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Fri Jul 17, 2026 00:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
327572239165,24sleep20-21swapper/219:08:462
327552239163,25sleep00-21swapper/019:08:440
325952235165,56sleep30-21swapper/319:06:403
325762203167,24sleep10-21swapper/119:06:271
217582970,3sleep048099cyclictest22:20:260
492997673,2cyclictest0-21swapper/222:56:162
105632570,4sleep310562-21cut23:10:173
492994845,2cyclictest0-21swapper/223:48:332
298942480,4sleep011-21rcuc/023:55:130
102682470,1sleep10-21swapper/119:30:111
480993810,13cyclictest25080-21munin-run23:45:010
48799377,3cyclictest24744-21hddtemp_smartct21:15:161
487993714,4cyclictest24466-21idleruntime-cro22:30:011
48099367,13cyclictest18485-21munin-run23:30:010
49299351,25cyclictest0-21swapper/221:00:372
49299351,25cyclictest0-21swapper/220:59:492
48799351,20cyclictest20068-21munin-run22:20:011
48799351,18cyclictest10989-21ntp_states23:10:221
48799341,25cyclictest0-21swapper/122:23:311
48799341,24cyclictest0-21swapper/122:50:271
48099348,12cyclictest5311-21perf23:00:010
48799330,5cyclictest0-21swapper/123:41:111
49299320,17cyclictest0-21swapper/200:21:182
48799327,19cyclictest0-21swapper/100:07:481
487993211,3cyclictest14021-21smart_sda00:30:241
48799311,7cyclictest0-21swapper/119:53:111
48799310,16cyclictest0-21swapper/100:15:171
48099316,12cyclictest23856-21awk21:15:010
48799301,13cyclictest0-21swapper/122:59:231
48799301,13cyclictest0-21swapper/122:30:111
48799301,13cyclictest0-21swapper/122:30:111
48799301,12cyclictest0-21swapper/122:38:391
48799301,11cyclictest0-21swapper/123:25:021
48099301,14cyclictest15045-21munin-run20:55:020
49299291,22cyclictest0-21swapper/200:30:422
49299291,18cyclictest0-21swapper/220:08:552
49299291,17cyclictest0-21swapper/220:48:232
49299290,22cyclictest0-21swapper/222:26:432
48799291,13cyclictest0-21swapper/100:20:031
48799291,12cyclictest16337-21ntp_states20:55:201
48799291,12cyclictest0-21swapper/123:56:341
48799291,12cyclictest0-21swapper/121:48:311
480992911,15cyclictest14095-21munin-run23:20:010
49299281,3cyclictest0-21swapper/220:30:252
49299281,12cyclictest0-21swapper/223:19:112
49299281,12cyclictest0-21swapper/219:39:022
49299281,11cyclictest21593-21diskstats19:55:132
49299281,11cyclictest0-21swapper/221:25:272
49299280,17cyclictest0-21swapper/219:34:102
48799281,13cyclictest0-21swapper/121:40:231
48799281,12cyclictest0-21swapper/121:00:341
48799281,11cyclictest0-21swapper/121:28:231
48799281,11cyclictest0-21swapper/119:44:391
48799281,10cyclictest0-21swapper/100:11:031
48099282,12cyclictest10655-21munin-run20:45:010
48099280,13cyclictest11907-21awk23:15:010
101902280,4sleep048099cyclictest19:30:020
49299271,13cyclictest0-21swapper/219:11:352
49299271,12cyclictest0-21swapper/222:06:512
49299271,12cyclictest0-21swapper/219:27:102
49299271,11cyclictest0-21swapper/200:37:422
49299271,10cyclictest0-21swapper/221:44:222
49299270,12cyclictest0-21swapper/221:52:582
49299270,11cyclictest0-21swapper/223:31:112
48799271,13cyclictest0-21swapper/123:03:301
48799271,12cyclictest0-21swapper/123:30:221
48799271,12cyclictest0-21swapper/120:16:071
48799271,12cyclictest0-21swapper/100:27:511
48799271,11cyclictest0-21swapper/122:08:471
48799271,11cyclictest0-21swapper/120:44:351
48799270,12cyclictest0-21swapper/119:35:111
49299261,11cyclictest0-21swapper/220:28:552
49299261,10cyclictest0-21swapper/222:38:232
49299260,8cyclictest0-21swapper/220:20:512
49299260,11cyclictest0-21swapper/222:24:272
49299260,11cyclictest0-21swapper/222:16:312
487992611,3cyclictest0-21swapper/123:22:581
48099260,4cyclictest0-21swapper/000:00:140
40312260,1sleep00-21swapper/021:40:250
49899252,15cyclictest25176-21pmu-power21:15:243
49299251,11cyclictest21641-21diskmemload23:13:292
49299251,11cyclictest0-21swapper/223:22:112
49299251,11cyclictest0-21swapper/222:01:372
49299251,11cyclictest0-21swapper/221:09:032
49299251,11cyclictest0-21swapper/220:13:292
49299251,10cyclictest87350irq/126-enp1s0-19:15:172
49299251,10cyclictest0-21swapper/220:39:412
49299250,9cyclictest0-21swapper/221:58:422
49299250,9cyclictest0-21swapper/221:10:112
49299250,20cyclictest0-21swapper/223:56:152
49299250,12cyclictest0-21swapper/200:19:222
49299250,11cyclictest0-21swapper/221:19:072
49299250,10cyclictest0-21swapper/222:46:392
49299250,10cyclictest0-21swapper/221:37:062
48799251,13cyclictest0-21swapper/123:39:501
48799251,12cyclictest0-21swapper/123:19:181
48799251,11cyclictest0-21swapper/120:54:141
48799251,11cyclictest0-21swapper/119:55:271
48099251,12cyclictest16924-21munin-run00:40:010
49899247,4cyclictest0-21swapper/322:15:223
49899241,6cyclictest0-21swapper/322:31:333
49899241,6cyclictest0-21swapper/322:31:333
49299246,3cyclictest0-21swapper/220:17:092
49299241,9cyclictest0-21swapper/219:52:452
49299241,11cyclictest0-21swapper/223:41:072
49299241,11cyclictest0-21swapper/220:54:152
49299241,10cyclictest28662-21kworker/u8:022:40:212
49299241,10cyclictest0-21swapper/221:33:062
49299241,10cyclictest0-21swapper/219:42:022
49299241,10cyclictest0-21swapper/219:24:352
49299241,10cyclictest0-21swapper/200:11:222
48799249,2cyclictest0-21swapper/120:05:151
48799241,8cyclictest0-21swapper/121:55:471
48799241,8cyclictest0-21swapper/121:10:261
48799241,12cyclictest0-21swapper/121:50:311
48799241,10cyclictest0-21swapper/123:06:581
48799241,10cyclictest0-21swapper/121:33:031
48099241,3cyclictest21638-21latency_hist21:10:010
48099241,13cyclictest13479-21munin-run22:05:010
49899233,3cyclictest87650irq/129-enp1s0-00:16:173
49899232,13cyclictest0-21swapper/322:00:143
49899231,6cyclictest0-21swapper/321:20:073
49899231,6cyclictest0-21swapper/321:20:073
49299231,11cyclictest0-21swapper/223:00:392
49299231,10cyclictest0-21swapper/219:48:112
49299230,9cyclictest0-21swapper/200:26:542
49299230,12cyclictest0-21swapper/222:50:252
49299230,10cyclictest0-21swapper/223:51:592
49299230,10cyclictest0-21swapper/200:01:102
48799235,6cyclictest89050irq/133-enp2s0-21:10:001
487992317,3cyclictest17525-21hddtemp_smartct19:45:181
48799231,15cyclictest0-21swapper/119:21:581
48799231,11cyclictest0-21swapper/122:04:311
48799231,10cyclictest0-21swapper/121:20:301
48799231,10cyclictest0-21swapper/121:20:301
48799231,10cyclictest0-21swapper/120:14:071
48099234,8cyclictest15917-21awk23:20:260
48099231,13cyclictest0-21swapper/022:09:320
49899221,6cyclictest0-21swapper/319:55:173
49299227,3cyclictest0-21swapper/200:05:342
49299221,9cyclictest0-21swapper/223:05:072
49299220,11cyclictest0-21swapper/223:27:512
48799228,3cyclictest0-21swapper/123:45:181
48799227,3cyclictest0-21swapper/121:38:551
48799226,2cyclictest0-21swapper/120:35:191
48799221,7cyclictest0-21swapper/123:52:381
48799221,13cyclictest0-21swapper/100:02:431
48099227,5cyclictest0-21swapper/000:28:260
48099220,13cyclictest6168-21/usr/sbin/munin00:15:170
49899211,6cyclictest0-21swapper/322:07:433
49899211,5cyclictest18245-1kworker/u9:223:47:243
49899211,4cyclictest0-21swapper/321:48:333
49299218,3cyclictest0-21swapper/223:37:072
49299217,3cyclictest0-21swapper/220:02:452
49299211,9cyclictest0-21swapper/222:11:072
49299211,11cyclictest0-21swapper/220:41:512
48799216,3cyclictest0-21swapper/122:49:111
48799215,3cyclictest0-21swapper/120:45:151
48799215,3cyclictest0-21swapper/120:03:431
48799211,17cyclictest4741-21grep20:30:161
48799211,17cyclictest30794-21taskset22:41:521
48099216,6cyclictest18095-21/usr/sbin/munin22:15:270
48099211,6cyclictest87350irq/126-enp1s0-23:55:020
48099211,6cyclictest17952-21sed22:15:010
48099211,5cyclictest0-21swapper/023:03:240
480992110,2cyclictest28464-21/usr/sbin/munin21:25:200
49899202,8cyclictest0-21swapper/323:30:133
49899202,10cyclictest30050-21/usr/sbin/munin20:15:273
49899201,7cyclictest31980-21idleruntime22:45:183
49899201,6cyclictest0-21swapper/321:11:043
49899201,5cyclictest0-21swapper/323:41:153
49899201,5cyclictest0-21swapper/321:31:493
49899201,11cyclictest3970-21/usr/sbin/munin00:10:153
49899201,11cyclictest3322-21/usr/sbin/munin22:55:273
49899201,11cyclictest25651-21/usr/sbin/munin20:05:173
49899201,11cyclictest16514-21/usr/sbin/munin23:25:193
49899201,11cyclictest10878-21/usr/sbin/munin20:45:133
49299207,3cyclictest0-21swapper/221:23:252
49299207,3cyclictest0-21swapper/221:23:242
49299200,8cyclictest0-21swapper/222:33:112
49299200,8cyclictest0-21swapper/222:33:112
487992014,3cyclictest8431-21/usr/sbin/munin19:25:141
48799201,13cyclictest15510-21perl00:35:151
48799201,12cyclictest0-21swapper/120:28:111
48799201,12cyclictest0-21swapper/120:24:391
48799201,11cyclictest16706-21irqstats22:10:181
48799201,11cyclictest0-21swapper/119:15:431
48099205,7cyclictest32243-21/usr/sbin/munin20:20:220
48099203,5cyclictest0-21swapper/022:43:260
48099203,2cyclictest0-21swapper/023:35:550
48099202,10cyclictest12760-21/usr/sbin/munin00:30:150
480992014,3cyclictest10841-21tune2fs19:30:150
48099201,13cyclictest0-21swapper/021:18:110
480992011,2cyclictest87350irq/126-enp1s0-23:30:130
48099201,12cyclictest0-21swapper/021:50:120
48099201,11cyclictest392-21/usr/sbin/munin21:35:190
48099201,10cyclictest7727-21/usr/sbin/munin23:05:220
309232200,4sleep341-21ksoftirqd/323:55:243
137552200,2sleep07-21ksoftirqd/019:35:240
49899197,3cyclictest12050irq/123-ahci[0019:15:023
49899191,6cyclictest0-21swapper/321:41:223
49899191,2cyclictest0-21swapper/300:31:343
498991912,4cyclictest2361-21fgrep22:50:253
498991912,4cyclictest13080-21grep19:35:153
49899191,11cyclictest0-21swapper/319:30:163
49899191,10cyclictest21481-21NetworkManager21:08:073
49899191,10cyclictest0-21swapper/323:00:153
492991913,3cyclictest5236-21df21:45:142
48799196,3cyclictest0-21swapper/119:11:431
48099198,3cyclictest27848-21/usr/sbin/munin20:10:150
48099198,3cyclictest23443-21/usr/sbin/munin20:00:210
48099196,5cyclictest0-21swapper/000:10:540
48099195,4cyclictest0-21swapper/022:25:350
48099192,14cyclictest27419-21ls23:50:020
48099192,14cyclictest18339-21unixbench-2d19:45:280
48099191,9cyclictest0-21swapper/000:05:490
48099191,8cyclictest0-21swapper/022:35:420
48099191,6cyclictest6493-21/usr/sbin/munin21:45:300
48099191,12cyclictest0-21swapper/020:35:140
48099191,10cyclictest30662-21/usr/sbin/munin21:30:350
48099190,13cyclictest7-21ksoftirqd/021:55:220
5592180,4sleep339-21rcuc/320:20:173
49899181,9cyclictest808-21snmpd23:36:313
49899181,7cyclictest12667-21cat00:30:013
49899181,6cyclictest0-21swapper/322:36:053
49899181,4cyclictest0-21swapper/323:18:223
49899181,4cyclictest0-21swapper/321:26:173
498991813,3cyclictest30551-21grep22:40:273
49899181,15cyclictest0-21swapper/320:31:013
49899181,14cyclictest29822-21ls20:15:013
48099185,7cyclictest5317-21kworker/0:219:19:060
48099184,3cyclictest12595-21kworker/u8:121:20:560
48099184,3cyclictest12595-21kworker/u8:121:20:560
48099183,3cyclictest4288-21/usr/sbin/munin20:30:240
48099182,6cyclictest87650irq/129-enp1s0-22:50:270
48099182,4cyclictest0-21swapper/022:31:250
48099182,4cyclictest0-21swapper/022:31:240
48099181,9cyclictest808-21snmpd19:55:420
48099181,6cyclictest0-21swapper/022:47:520
48099181,6cyclictest0-21swapper/021:00:190
48099181,5cyclictest0-21swapper/020:25:220
49899178,2cyclictest27504-21/usr/sbin/munin23:50:273
49899173,4cyclictest0-21swapper/322:25:153
49899172,6cyclictest0-21swapper/321:35:223
49899171,9cyclictest0-21swapper/322:24:323
49899171,7cyclictest21641-21diskmemload22:10:163
49899171,7cyclictest0-21swapper/323:22:323
49899171,6cyclictest7114-21grep21:50:123
498991712,3cyclictest8067-21/usr/sbin/munin19:25:213
49899171,14cyclictest0-21swapper/323:05:523
49899171,11cyclictest0-21swapper/321:55:313
49899170,15cyclictest0-21swapper/300:05:463
48099173,2cyclictest8365-21/usr/sbin/munin00:20:230
48099172,7cyclictest14654-21/usr/sbin/munin19:40:230
480991713,3cyclictest0-21swapper/020:59:200
48099171,14cyclictest0-21swapper/019:20:060
207912171,2sleep00-21swapper/019:52:140
152652171,3sleep30-21swapper/320:55:103
49899162,11cyclictest14817-21tr19:40:123
49899161,6cyclictest3115-21missed_timers19:15:023
49899161,4cyclictest0-21swapper/300:21:453
498991612,3cyclictest0-21swapper/320:37:323
49899161,14cyclictest0-21swapper/320:53:213
498991611,3cyclictest5869-21/usr/sbin/munin19:20:253
498991611,3cyclictest3509-21sed20:25:253
498991611,3cyclictest31907-21/usr/sbin/munin00:00:163
498991611,3cyclictest19049-21/usr/sbin/munin19:50:173
498991611,3cyclictest17156-21expr19:45:143
498991611,3cyclictest15579-21gltestperf00:35:163
49899160,10cyclictest0-21swapper/321:00:253
48099164,2cyclictest30678-21grep20:15:160
48099161,6cyclictest0-21swapper/020:45:160
48099160,10cyclictest0-21swapper/019:10:160
269882161,2sleep00-21swapper/020:05:270
498991510,3cyclictest23443-21/usr/sbin/munin20:00:163
49899150,6cyclictest0-21swapper/320:40:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional