You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-06 - 00:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails
  Congatec
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Wed Nov 05, 2025 12:43:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3739885994770,473cyclictest3986738-21kworker/u8:1+efi_rts_wq12:25:161
3739889994751,470cyclictest3906594-21kworker/u8:0+efi_rts_wq09:20:152
3739881994750,472cyclictest3739800-21kworker/u8:2+efi_rts_wq09:00:120
3739881994711,467cyclictest16240-21kworker/u8:0+efi_rts_wq12:35:140
3739889994670,464cyclictest3797547-21kworker/u8:0+efi_rts_wq08:52:022
3739885994671,463cyclictest3986738-21kworker/u8:1+efi_rts_wq11:57:381
3739881994671,463cyclictest4091446-21kworker/u8:0+efi_rts_wq11:25:130
3739881994670,464cyclictest1963872-21kworker/u8:1+efi_rts_wq07:36:460
3739889994661,462cyclictest3897053-21kworker/u8:3+efi_rts_wq09:35:132
3739885994650,462cyclictest3928853-21kworker/u8:2+efi_rts_wq09:57:161
3739889994641,460cyclictest3906594-21kworker/u8:0+efi_rts_wq10:35:152
3739885994640,461cyclictest3906594-21kworker/u8:0+efi_rts_wq10:20:131
3739881994641,460cyclictest3986738-21kworker/u8:1+efi_rts_wq12:05:100
3739889994620,459cyclictest646835-21kworker/u8:3+efi_rts_wq07:41:472
3739885994610,457cyclictest3914856-21kworker/u8:1+efi_rts_wq09:25:121
3739885994601,455cyclictest3928853-21kworker/u8:2+efi_rts_wq10:10:121
3739889994591,455cyclictest3739800-21kworker/u8:2+efi_rts_wq08:25:142
3739885994590,456cyclictest32405-21kworker/u8:3+efi_rts_wq12:37:441
3739881994590,455cyclictest3928853-21kworker/u8:2+efi_rts_wq09:32:090
3739889994580,455cyclictest3739800-21kworker/u8:2+efi_rts_wq08:20:152
3739889994571,453cyclictest3986738-21kworker/u8:1+efi_rts_wq12:10:132
3739885994570,454cyclictest3739800-21kworker/u8:2+efi_rts_wq08:42:001
3739881994560,453cyclictest16240-21kworker/u8:0+efi_rts_wq12:27:430
3739885994541,450cyclictest1963872-21kworker/u8:1+efi_rts_wq07:20:141
3739889994530,450cyclictest1963872-21kworker/u8:1+efi_rts_wq07:10:132
3739889994530,449cyclictest646835-21kworker/u8:3+efi_rts_wq07:46:482
3739881994531,449cyclictest1963872-21kworker/u8:1+efi_rts_wq07:11:410
3739881994531,449cyclictest16240-21kworker/u8:0+efi_rts_wq12:30:160
3739889994501,446cyclictest3906594-21kworker/u8:0+efi_rts_wq10:50:142
3739885994500,447cyclictest3928853-21kworker/u8:2+efi_rts_wq10:00:131
3739881994491,445cyclictest3906594-21kworker/u8:0+efi_rts_wq09:20:140
3739889994471,443cyclictest3739800-21kworker/u8:2+efi_rts_wq08:00:122
3739889994450,441cyclictest3906594-21kworker/u8:0+efi_rts_wq10:07:182
3739889994431,438cyclictest3906594-21kworker/u8:0+efi_rts_wq10:45:162
3739881994421,438cyclictest3906594-21kworker/u8:0+efi_rts_wq10:05:150
3739889994400,437cyclictest3986738-21kworker/u8:1+efi_rts_wq11:05:182
3739885994371,432cyclictest4073422-21kworker/u8:2+efi_rts_wq11:25:121
3739885994370,433cyclictest4057699-21kworker/u8:3+efi_rts_wq11:07:271
3739881994371,433cyclictest3739800-21kworker/u8:2+efi_rts_wq08:05:160
3739885994361,432cyclictest4091447-21kworker/u8:4+efi_rts_wq11:35:141
3739881994361,431cyclictest3914856-21kworker/u8:1+efi_rts_wq09:25:120
3739889994330,430cyclictest3986738-21kworker/u8:1+efi_rts_wq12:20:122
3739881994330,429cyclictest3928853-21kworker/u8:2+efi_rts_wq10:30:170
3739889994280,425cyclictest3938150-21kworker/u8:1+efi_rts_wq09:47:132
3739881994200,417cyclictest3739800-21kworker/u8:2+efi_rts_wq08:11:530
3739889994190,416cyclictest3897053-21kworker/u8:3+efi_rts_wq10:20:132
3739889994180,415cyclictest3897053-21kworker/u8:3+efi_rts_wq10:40:142
3739881994161,412cyclictest3986738-21kworker/u8:1+efi_rts_wq11:40:140
3739881994160,413cyclictest4073422-21kworker/u8:2+efi_rts_wq11:55:120
3739889994130,410cyclictest3928853-21kworker/u8:2+efi_rts_wq09:50:122
3739885994131,409cyclictest3928853-21kworker/u8:2+efi_rts_wq09:40:121
3739889994101,406cyclictest3739800-21kworker/u8:2+efi_rts_wq08:45:142
3739889994100,407cyclictest3914856-21kworker/u8:1+efi_rts_wq09:30:172
3739881994080,405cyclictest4073422-21kworker/u8:2+efi_rts_wq12:15:130
3739881994080,404cyclictest4146035-21kworker/u8:3+efi_rts_wq11:50:130
3739885994061,401cyclictest4091446-21kworker/u8:0+efi_rts_wq11:52:361
3739885994060,403cyclictest1963872-21kworker/u8:1+efi_rts_wq07:10:131
3739889994041,399cyclictest4091446-21kworker/u8:0+efi_rts_wq11:20:132
3739889994040,401cyclictest3928853-21kworker/u8:2+efi_rts_wq10:02:162
3739889994040,401cyclictest3739800-21kworker/u8:2+efi_rts_wq08:35:152
3739881994031,399cyclictest3897053-21kworker/u8:3+efi_rts_wq10:42:230
3739889994020,398cyclictest4073422-21kworker/u8:2+efi_rts_wq11:15:142
3739881994020,399cyclictest3986738-21kworker/u8:1+efi_rts_wq11:30:160
3739881994020,399cyclictest3906594-21kworker/u8:0+efi_rts_wq10:50:150
3739885994011,397cyclictest3986738-21kworker/u8:1+efi_rts_wq11:30:161
3739881993981,393cyclictest3897053-21kworker/u8:3+efi_rts_wq09:12:060
3739885993970,394cyclictest3797547-21kworker/u8:0+efi_rts_wq08:31:581
3739889993960,392cyclictest3897053-21kworker/u8:3+efi_rts_wq09:15:132
3739885993960,393cyclictest3986738-21kworker/u8:1+efi_rts_wq11:10:111
3739881993961,392cyclictest3739800-21kworker/u8:2+efi_rts_wq08:35:150
3739881993960,393cyclictest4073422-21kworker/u8:2+efi_rts_wq12:00:150
3739889993950,392cyclictest1963872-21kworker/u8:1+efi_rts_wq07:15:032
3739881993941,390cyclictest3739800-21kworker/u8:2+efi_rts_wq08:26:570
3739889993930,390cyclictest4057699-21kworker/u8:3+efi_rts_wq10:55:132
3739889993901,386cyclictest4164337-21kworker/u8:4+efi_rts_wq12:00:152
3739881993891,385cyclictest3797547-21kworker/u8:0+efi_rts_wq08:15:160
3739881993890,386cyclictest1963872-21kworker/u8:1+efi_rts_wq07:26:440
3739881993850,382cyclictest1963872-21kworker/u8:1+efi_rts_wq07:51:500
3739885993840,380cyclictest3797547-21kworker/u8:0+efi_rts_wq08:50:131
3739881993840,381cyclictest3797547-21kworker/u8:0+efi_rts_wq09:05:130
3739885993831,379cyclictest646835-21kworker/u8:3+efi_rts_wq07:35:161
3739885993830,380cyclictest3986738-21kworker/u8:1+efi_rts_wq10:25:151
3739885993821,378cyclictest1963872-21kworker/u8:1+efi_rts_wq07:25:141
3739885993820,379cyclictest3906594-21kworker/u8:0+efi_rts_wq10:05:151
3739889993810,378cyclictest4091446-21kworker/u8:0+efi_rts_wq11:45:162
3739881993810,378cyclictest3739800-21kworker/u8:2+efi_rts_wq07:56:500
3739889993800,377cyclictest3797547-21kworker/u8:0+efi_rts_wq07:55:162
3739889993800,376cyclictest3986738-21kworker/u8:1+efi_rts_wq12:35:142
3739885993801,375cyclictest3986738-21kworker/u8:1+efi_rts_wq12:30:161
3739889993780,375cyclictest3739800-21kworker/u8:2+efi_rts_wq08:55:142
3739889993780,375cyclictest1963872-21kworker/u8:1+efi_rts_wq07:50:142
3739885993760,372cyclictest1963872-21kworker/u8:1+efi_rts_wq09:15:131
3739885993750,372cyclictest3797547-21kworker/u8:0+efi_rts_wq07:55:161
3739885993720,369cyclictest3914856-21kworker/u8:1+efi_rts_wq09:30:171
3739885993720,369cyclictest1963872-21kworker/u8:1+efi_rts_wq07:50:141
3739881993711,367cyclictest3928853-21kworker/u8:2+efi_rts_wq09:45:160
3739881993650,362cyclictest3797547-21kworker/u8:0+efi_rts_wq08:30:130
3739885993640,361cyclictest1963872-21kworker/u8:1+efi_rts_wq07:15:161
3739889993620,359cyclictest3986738-21kworker/u8:1+efi_rts_wq11:27:312
3739885993620,359cyclictest4091446-21kworker/u8:0+efi_rts_wq11:40:151
3739889993610,358cyclictest4073422-21kworker/u8:2+efi_rts_wq11:10:112
3739889993600,357cyclictest3938150-21kworker/u8:1+efi_rts_wq09:55:132
3739885993580,355cyclictest3897053-21kworker/u8:3+efi_rts_wq09:35:131
3739889993550,351cyclictest3906594-21kworker/u8:0+efi_rts_wq10:15:152
3739881993550,352cyclictest1963872-21kworker/u8:1+efi_rts_wq07:15:160
3739881993550,351cyclictest646835-21kworker/u8:3+efi_rts_wq07:40:150
3739885993540,351cyclictest3897053-21kworker/u8:3+efi_rts_wq09:50:111
3739885993530,350cyclictest3928853-21kworker/u8:2+efi_rts_wq09:45:151
3739889993520,349cyclictest3797547-21kworker/u8:0+efi_rts_wq09:10:142
3739885993520,349cyclictest3897053-21kworker/u8:3+efi_rts_wq10:35:151
3739881993480,345cyclictest1963872-21kworker/u8:1+efi_rts_wq07:30:130
3739881993470,343cyclictest4091446-21kworker/u8:0+efi_rts_wq11:37:350
3739881993450,342cyclictest3739800-21kworker/u8:2+efi_rts_wq08:00:120
3739889993430,340cyclictest3928853-21kworker/u8:2+efi_rts_wq10:10:122
3739885993400,336cyclictest3906594-21kworker/u8:0+efi_rts_wq10:45:161
3739885993380,334cyclictest3986738-21kworker/u8:1+efi_rts_wq10:50:151
3739889993370,334cyclictest3986738-21kworker/u8:1+efi_rts_wq11:00:142
3739881993370,333cyclictest3986738-21kworker/u8:1+efi_rts_wq11:00:140
3739889993350,329cyclictest4091446-21kworker/u8:0+efi_rts_wq11:40:152
3739881993340,331cyclictest3897053-21kworker/u8:3+efi_rts_wq10:27:190
3739889993330,330cyclictest3928853-21kworker/u8:2+efi_rts_wq10:30:172
3739885993330,330cyclictest3739800-21kworker/u8:2+efi_rts_wq08:01:521
3739889993260,323cyclictest3739800-21kworker/u8:2+efi_rts_wq09:02:032
3739885993260,323cyclictest4073422-21kworker/u8:2+efi_rts_wq12:02:381
3739881993260,323cyclictest3938150-21kworker/u8:1+efi_rts_wq09:42:110
3739885993240,321cyclictest1963872-21kworker/u8:1+efi_rts_wq07:31:451
3739889993200,317cyclictest3797547-21kworker/u8:0+efi_rts_wq09:07:052
3739881993170,314cyclictest3986738-21kworker/u8:1+efi_rts_wq11:17:290
3739881993120,309cyclictest3897053-21kworker/u8:3+efi_rts_wq09:52:140
3739881993120,308cyclictest3906594-21kworker/u8:0+efi_rts_wq10:17:200
3739889993110,308cyclictest1963872-21kworker/u8:1+efi_rts_wq07:20:142
3739885993100,307cyclictest3986738-21kworker/u8:1+efi_rts_wq12:10:131
3739885993090,306cyclictest3739800-21kworker/u8:2+efi_rts_wq08:47:021
3739885993060,303cyclictest646835-21kworker/u8:3+efi_rts_wq07:45:131
3739889993050,302cyclictest3986738-21kworker/u8:1+efi_rts_wq12:25:152
3739881993040,301cyclictest4091446-21kworker/u8:0+efi_rts_wq11:22:300
3739885993020,299cyclictest3906594-21kworker/u8:0+efi_rts_wq10:57:251
3739881993020,299cyclictest3897053-21kworker/u8:3+efi_rts_wq10:12:180
3739881993020,298cyclictest3906594-21kworker/u8:0+efi_rts_wq10:37:210
3739889992990,296cyclictest3914856-21kworker/u8:1+efi_rts_wq09:27:082
3739885992930,290cyclictest3797547-21kworker/u8:0+efi_rts_wq09:05:121
3739881992920,288cyclictest3986738-21kworker/u8:1+efi_rts_wq12:22:430
3739885992860,283cyclictest3986738-21kworker/u8:1+efi_rts_wq12:20:131
3739885992860,283cyclictest3986738-21kworker/u8:1+efi_rts_wq11:47:361
3739881993220,11cyclictest1-21systemd09:20:000
38126432250,1sleep23812646-21cat08:05:202
3739885992421,2cyclictest744-21cups-browsed08:10:011
3739891992219,1cyclictest0-21swapper/311:25:143
3739881992213,8cyclictest3866164-21latency_hist08:50:010
3739891992118,1cyclictest0-21swapper/308:20:003
373988199218,3cyclictest4003167-21cpu10:20:130
373988199216,4cyclictest4067320-21cat11:00:000
373988199215,2cyclictest157898rtkit-daemon11:10:160
3739891992017,1cyclictest0-21swapper/310:05:143
3739889992017,2cyclictest0-21swapper/211:35:002
373988199207,3cyclictest0-21swapper/011:05:550
3739881992010,9cyclictest0-21swapper/009:55:140
3739881992010,8cyclictest3931138-21tail09:35:140
373988199200,4cyclictest3867310-21grep08:50:160
157898200,2rtkit-daemon3972185-21sed10:00:160
3739891991916,1cyclictest0-21swapper/310:20:013
3739885991914,4cyclictest4180283-21munin-plugin-st12:10:001
373988199198,10cyclictest0-21swapper/007:20:240
373988199197,2cyclictest0-21swapper/008:25:000
373988199196,2cyclictest3857610-21runrttasks08:40:190
3739881991914,3cyclictest3878425-21sendmail09:00:000
373988199190,10cyclictest4145291-21memory11:45:220
3739891991815,1cyclictest0-21swapper/312:00:263
3739891991815,1cyclictest0-21swapper/311:20:143
3739891991815,1cyclictest0-21swapper/311:05:003
3739891991815,1cyclictest0-21swapper/310:25:003
3739891991815,1cyclictest0-21swapper/310:00:193
3739891991815,1cyclictest0-21swapper/308:40:003
3739891991815,1cyclictest0-21swapper/307:25:003
373988199181,6cyclictest3739882-21ls07:10:010
373988199180,6cyclictest4180942-21gltestperf12:10:160
3739891991714,1cyclictest0-21swapper/312:31:313
3739891991714,1cyclictest0-21swapper/312:25:183
3739891991714,1cyclictest0-21swapper/310:30:233
3739891991714,1cyclictest0-21swapper/309:40:193
3739891991714,1cyclictest0-21swapper/309:00:163
3739891991714,1cyclictest0-21swapper/308:25:013
3739889991713,3cyclictest4124955-21irqcore11:35:152
373988199175,2cyclictest0-21swapper/010:45:160
3739891991614,1cyclictest0-21swapper/311:40:193
3739891991614,1cyclictest0-21swapper/308:30:243
3739891991613,1cyclictest0-21swapper/312:35:193
3739891991613,1cyclictest0-21swapper/312:10:173
3739891991613,1cyclictest0-21swapper/311:05:223
3739891991613,1cyclictest0-21swapper/310:50:173
3739891991613,1cyclictest0-21swapper/309:20:163
3739891991613,1cyclictest0-21swapper/309:10:153
3739891991613,1cyclictest0-21swapper/307:50:163
3739891991613,1cyclictest0-21swapper/307:46:183
3739891991613,1cyclictest0-21swapper/307:35:363
3739889991613,2cyclictest3766835-21latency_hist07:30:012
3739889991613,2cyclictest1-21systemd07:35:342
373988999160,3cyclictest4164279-21cron12:00:012
3739885991613,2cyclictest3835360-21apt-config08:25:001
3739885991613,2cyclictest3822684-21latency_hist08:15:001
3739885991612,3cyclictest4099536-21systemctl11:20:001
3739885991612,2cyclictest0-21swapper/112:15:231
373988599161,14cyclictest3878714-21apt-get09:00:101
373988199168,7cyclictest3786333-21tr07:45:160
3739891991512,1cyclictest0-21swapper/312:20:133
3739891991512,1cyclictest0-21swapper/311:55:173
3739891991512,1cyclictest0-21swapper/311:10:163
3739891991512,1cyclictest0-21swapper/310:38:423
3739891991512,1cyclictest0-21swapper/309:55:133
3739891991512,1cyclictest0-21swapper/309:47:083
3739891991512,1cyclictest0-21swapper/309:30:203
3739891991512,1cyclictest0-21swapper/308:25:153
3739891991512,1cyclictest0-21swapper/308:10:153
3739891991512,1cyclictest0-21swapper/308:05:213
3739891991511,2cyclictest0-21swapper/312:15:173
3739889991512,2cyclictest520-21in:imuxsock12:10:012
3739889991512,2cyclictest3847755-21latency_hist08:35:002
3739889991512,2cyclictest3822803-21latency_hist08:15:022
373988599155,9cyclictest3898712-21awk09:15:011
3739885991512,2cyclictest755-21runrttasks10:31:281
3739885991512,2cyclictest3890773-21diskmemload11:20:131
3739885991512,2cyclictest3785101-21unixbench-2d07:40:241
3739885991512,2cyclictest0-21swapper/108:30:001
3739885991511,3cyclictest1-21systemd11:01:321
3739891991412,1cyclictest0-21swapper/311:55:003
3739891991412,1cyclictest0-21swapper/307:10:133
3739891991411,1cyclictest0-21swapper/311:37:043
3739891991411,1cyclictest0-21swapper/311:30:223
3739891991411,1cyclictest0-21swapper/310:55:123
3739891991411,1cyclictest0-21swapper/310:30:013
3739891991411,1cyclictest0-21swapper/310:14:513
3739891991411,1cyclictest0-21swapper/309:25:153
3739891991411,1cyclictest0-21swapper/309:10:013
3739891991411,1cyclictest0-21swapper/308:50:183
3739891991411,1cyclictest0-21swapper/308:45:183
3739891991411,1cyclictest0-21swapper/307:55:223
3739891991411,1cyclictest0-21swapper/307:40:173
3739891991411,1cyclictest0-21swapper/307:25:153
3739889991411,2cyclictest4193711-21ntp_offset12:15:212
3739889991411,2cyclictest4011596-21irqcore10:25:172
3739889991411,2cyclictest3940957-21kthreadcore09:40:172
3739889991411,2cyclictest3859492-21unixbench_multi08:40:252
3739889991411,2cyclictest3767479-21gltestperf07:30:142
3739885991410,3cyclictest3908476-21sort09:20:181
373988599140,12cyclictest4043019-21cron10:44:591
3739891991310,1cyclictest0-21swapper/311:15:343
3739891991310,1cyclictest0-21swapper/310:40:193
3739891991310,1cyclictest0-21swapper/309:50:073
3739891991310,1cyclictest0-21swapper/309:17:563
3739891991310,1cyclictest0-21swapper/308:40:593
3739891991310,1cyclictest0-21swapper/308:00:163
373988999131,2cyclictest191rcu_preempt12:35:002
373988599139,2cyclictest0-21swapper/110:20:021
373989199129,1cyclictest0-21swapper/308:55:193
373989199129,1cyclictest0-21swapper/307:15:063
3739891991210,1cyclictest0-21swapper/312:05:023
3739891991210,1cyclictest0-21swapper/311:45:153
3739891991210,1cyclictest0-21swapper/310:45:073
3739891991210,1cyclictest0-21swapper/309:38:013
3739891991210,1cyclictest0-21swapper/307:30:333
373988599128,3cyclictest3872832-21gltestperf08:55:161
373988999118,2cyclictest0-21swapper/211:50:132
373988999118,2cyclictest0-21swapper/208:15:142
373988599117,3cyclictest3852969-21grep08:35:231
373988599117,2cyclictest0-21swapper/108:15:191
37398859996,2cyclictest19350irq/126-ahci[0000:00:17.0]07:10:011
3739724290,2sleep30-21swapper/307:09:563
15789880,4rtkit-daemon3701873-21munin-node07:07:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional