You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-01 - 04:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Apr 01, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
858465994540,3cyclictest1045684-21latency_hist22:10:020
858472994237,3cyclictest1020062-21kworker/u8:4+flush-259:022:49:591
858465994239,2cyclictest864112-21kworker/u8:0+flush-259:019:50:010
858477993932,5cyclictest1181750-21latency_hist00:25:002
858465993733,3cyclictest864112-21kworker/u8:0+flush-259:019:25:250
858465993629,5cyclictest1051520-21/usr/sbin/munin22:15:120
858472993532,2cyclictest1154644-21kworker/u8:3+events_unbound00:20:231
858465993533,1cyclictest1051069-21fwupd22:13:000
858465993532,2cyclictest1171259-21apt-get00:15:110
858472993427,4cyclictest993718-21latency_hist21:20:001
858480993321,3cyclictest972931-21apt-get21:00:143
858477993328,4cyclictest1171172-21cat00:15:012
858477993228,3cyclictest910489-21gpgv20:00:012
858477993227,3cyclictest1192285-40mandb00:33:202
858477993226,4cyclictest1108185-21/usr/sbin/munin23:10:222
858472993228,3cyclictest1154644-21kworker/u8:3+flush-259:023:55:211
858465993226,4cyclictest1019832-21latency_hist21:45:010
858477993126,4cyclictest1056507-21kworker/u8:0+flush-259:022:40:162
858477993123,5cyclictest252-21systemd-journal23:10:012
858472993128,2cyclictest1138974-21kworker/u8:1+flush-259:000:15:201
858472993127,2cyclictest951973-21kworker/u8:3+flush-259:022:05:231
858472993126,3cyclictest1020062-21kworker/u8:4+flush-259:022:50:251
858472993026,3cyclictest1019848-21kworker/u8:1+flush-259:021:50:231
858465993025,4cyclictest1123695-21/usr/sbin/munin23:25:140
858480992924,3cyclictest842726-21kworker/u8:2+flush-259:019:35:173
858480992923,4cyclictest252-21systemd-journal23:41:213
858472992926,2cyclictest1138974-21kworker/u8:1+flush-259:023:50:221
858472992925,3cyclictest842726-21kworker/u8:2+flush-259:019:20:001
858472992923,4cyclictest252-21systemd-journal20:15:001
858465992925,3cyclictest864112-21kworker/u8:0+events_unbound19:15:180
858465992925,3cyclictest826249-21kworker/u8:1+events_unbound19:30:250
858480992823,3cyclictest1035624-21/usr/sbin/munin22:00:143
858480992822,4cyclictest982993-21latency_hist21:10:003
858472992825,2cyclictest951973-21kworker/u8:3+flush-259:020:50:161
858472992825,2cyclictest864112-21kworker/u8:0+flush-259:019:50:211
858472992824,3cyclictest1181705-21kworker/u8:0+events_unbound00:30:171
858465992824,3cyclictest1019848-21kworker/u8:1+flush-259:021:50:180
858477992722,3cyclictest1040547-21latency_hist22:05:012
858472992723,3cyclictest879223-21apt-get19:30:121
858472992723,3cyclictest842726-21kworker/u8:2+events_unbound19:55:041
858472992723,3cyclictest1020062-21kworker/u8:4+events_unbound23:20:251
858472992723,2cyclictest931418-21kworker/u8:0+flush-259:020:30:231
858472992722,3cyclictest852868-21kworker/u8:3+events_unbound19:10:161
858472992722,3cyclictest1020062-21kworker/u8:4+flush-259:022:40:161
858465992723,3cyclictest957398-21apt-get20:45:120
858465992723,3cyclictest842726-21kworker/u8:2+flush-259:019:55:160
858465992721,4cyclictest252-21systemd-journal22:41:450
858480992622,3cyclictest951974-21kworker/u8:4+flush-259:020:55:233
858480992620,4cyclictest864112-21kworker/u8:0+flush-259:019:50:163
858472992623,2cyclictest899607-21kworker/u8:1+events_unbound20:15:201
858472992617,7cyclictest252-21systemd-journal22:20:001
858465992621,4cyclictest1020062-21kworker/u8:4+flush-259:023:35:150
858465992621,3cyclictest842726-21kworker/u8:2+flush-259:020:00:160
858480992519,4cyclictest1133790-21latency_hist23:35:013
858480992519,4cyclictest1133790-21latency_hist23:35:003
858472992522,2cyclictest842726-21kworker/u8:2+events_unbound20:00:231
858472992521,3cyclictest1020062-21kworker/u8:4+flush-259:023:05:241
858472992521,3cyclictest1020062-21kworker/u8:4+flush-259:022:21:491
858465992521,3cyclictest864112-21kworker/u8:0+flush-259:019:20:250
858465992520,4cyclictest1181748-21apt-get00:25:010
858480992417,5cyclictest1081339-21ntpq22:40:203
858472992421,2cyclictest962503-21kworker/u8:2+flush-259:021:25:181
858472992421,2cyclictest864112-21kworker/u8:0+events_unbound19:25:241
858472992421,2cyclictest1118348-21kworker/u8:1+events_unbound23:25:141
858472992420,3cyclictest931418-21kworker/u8:0+flush-259:020:45:151
858465992417,5cyclictest893575-21ntpq19:40:220
858465992416,5cyclictest509-21rs:main0
858480992318,3cyclictest252-21systemd-journal19:24:203
858477992318,4cyclictest988106-21apt-get21:15:022
858472992319,3cyclictest931418-21kworker/u8:0+flush-259:020:35:231
858472992319,3cyclictest931418-21kworker/u8:0+events_unbound20:40:201
858472992319,3cyclictest1020062-21kworker/u8:4+events_unbound23:35:131
858472992316,5cyclictest252-21systemd-journal21:00:001
858472992316,5cyclictest1071900-21latency_hist22:35:011
858465992319,3cyclictest1020062-21kworker/u8:4+flush-259:022:25:160
858465992318,3cyclictest962537-21apt-get20:50:110
858480992217,4cyclictest951974-21kworker/u8:4+flush-259:020:50:003
858480992215,5cyclictest1107019-21ntpq23:05:203
858477992215,5cyclictest1117429-21ntpq23:15:202
858477992215,5cyclictest1097639-21latency_hist23:00:012
858480992118,2cyclictest1181748-21apt-get00:25:033
858480992115,4cyclictest921335-21apt-get20:10:113
85847799215,8cyclictest921083-21awk20:10:002
858477992117,3cyclictest931418-21kworker/u8:0+flush-259:020:35:252
858472992118,2cyclictest842726-21kworker/u8:2+flush-259:019:40:221
858472992118,2cyclictest1077097-21kworker/u8:2+events_unbound23:10:151
858472992117,3cyclictest1181705-21kworker/u8:0+flush-259:000:25:211
858472992117,3cyclictest1056507-21kworker/u8:0+events_unbound22:40:021
858465992118,2cyclictest1133478-21kworker/u8:0+flush-259:023:45:230
858465992117,3cyclictest962503-21kworker/u8:2+flush-259:021:20:250
858480992014,4cyclictest988494-21cp21:15:003
858480992014,4cyclictest915941-21latency_hist20:05:013
858480992014,4cyclictest252-21systemd-journal23:51:213
858477992013,5cyclictest1192887-21diskstats00:35:142
858472992016,3cyclictest962503-21kworker/u8:2+events_unbound21:31:221
858472992016,3cyclictest951973-21kworker/u8:3+events_unbound22:01:221
858472992016,3cyclictest1133478-21kworker/u8:0+events_unbound23:45:141
85847299201,12cyclictest1014251-21awk21:40:001
858465992016,3cyclictest1020062-21kworker/u8:4+flush-259:023:20:200
858465992016,3cyclictest1020062-21kworker/u8:4+flush-259:022:45:230
858465992015,4cyclictest931418-21kworker/u8:0+events_unbound20:25:230
858465992014,4cyclictest1009133-21latency_hist21:35:000
858480991913,4cyclictest509-21rs:main3
858477991913,4cyclictest946839-21latency_hist20:35:002
858472991916,2cyclictest931418-21kworker/u8:0+flush-259:020:25:221
858472991916,2cyclictest1045724-21kworker/u8:1+flush-259:022:13:371
858472991915,3cyclictest864112-21kworker/u8:0+flush-259:019:25:001
858472991915,3cyclictest1077097-21kworker/u8:2+flush-259:022:55:151
858472991914,4cyclictest1175199-21kworker/u8:2+events_unbound00:35:241
858472991914,3cyclictest1138974-21kworker/u8:1+flush-259:000:10:211
858465991916,2cyclictest899607-21kworker/u8:1+flush-259:020:15:210
858465991915,3cyclictest962503-21kworker/u8:2+flush-259:021:05:170
858465991915,3cyclictest490-21dbus-daemon21:40:000
858465991915,3cyclictest1138974-21kworker/u8:1+flush-259:000:20:190
858465991914,4cyclictest899607-21kworker/u8:1+events_unbound20:10:140
858465991913,4cyclictest252-21systemd-journal21:02:210
858480991813,4cyclictest1020062-21kworker/u8:4+flush-259:021:55:003
858477991815,2cyclictest951974-21kworker/u8:4+flush-259:020:55:252
858477991814,3cyclictest252-21systemd-journal22:09:212
858465991815,2cyclictest951974-21kworker/u8:4+flush-259:020:55:340
858465991815,2cyclictest1077097-21kworker/u8:2+flush-259:022:55:230
858465991814,3cyclictest1020062-21kworker/u8:4+flush-259:023:30:210
858465991814,3cyclictest1020062-21kworker/u8:4+flush-259:023:30:200
858465991812,4cyclictest252-21systemd-journal22:21:220
858480991713,3cyclictest1020062-21kworker/u8:4+flush-259:022:36:573
858480991711,4cyclictest252-21systemd-journal00:16:283
858477991713,3cyclictest899607-21kworker/u8:1+flush-259:021:05:002
858477991712,3cyclictest252-21systemd-journal19:26:192
858472991714,2cyclictest1020062-21kworker/u8:4+events_unbound23:02:091
858472991713,3cyclictest842726-21kworker/u8:2+events_unbound19:35:131
858472991713,3cyclictest1154644-21kworker/u8:3+flush-259:000:00:151
858472991713,3cyclictest1020062-21kworker/u8:4+flush-259:023:30:161
858472991713,3cyclictest1020062-21kworker/u8:4+flush-259:023:30:151
85846599179,6cyclictest252-21systemd-journal19:55:000
858465991714,2cyclictest1138974-21kworker/u8:1+flush-259:000:10:100
858465991712,4cyclictest1020062-21kworker/u8:4+flush-259:023:05:180
858465991711,4cyclictest916173-21/usr/sbin/munin20:05:210
858480991612,3cyclictest962503-21kworker/u8:2+flush-259:021:35:243
858480991610,4cyclictest252-21systemd-journal23:24:223
858480991610,4cyclictest252-21systemd-journal20:52:213
858477991614,1cyclictest1014239-21sh21:40:002
858477991613,2cyclictest905214-21apt-config19:55:012
858477991612,3cyclictest1133478-21kworker/u8:0+flush-259:023:45:242
858477991611,4cyclictest899607-21kworker/u8:1+flush-259:020:10:212
858472991613,2cyclictest1154644-21kworker/u8:3+events_unbound00:06:111
858472991613,2cyclictest1056507-21kworker/u8:0+events_unbound22:28:211
858472991611,3cyclictest0-21swapper/121:05:011
858465991613,2cyclictest60350irq/132-enp0s29f1:rx-023:15:210
858465991613,2cyclictest60350irq/132-enp0s29f1:rx-021:13:380
858465991613,2cyclictest1077097-21kworker/u8:2+events_unbound23:00:150
858465991612,3cyclictest962503-21kworker/u8:2+events_unbound21:25:220
858465991612,3cyclictest931418-21kworker/u8:0+flush-259:020:40:200
858465991612,3cyclictest1056507-21kworker/u8:0+events_unbound22:30:120
858465991612,3cyclictest1020062-21kworker/u8:4+events_unbound22:35:150
858480991512,2cyclictest1148406-21ntp_offset23:45:223
85848099151,13cyclictest1-21systemd00:03:283
858480991511,3cyclictest1067008-21apt-get22:30:103
858477991513,1cyclictest1009116-21cron21:35:002
858477991512,2cyclictest1133478-21kworker/u8:0+flush-259:023:35:002
858477991512,2cyclictest1133478-21kworker/u8:0+flush-259:023:34:592
858477991512,2cyclictest0-21swapper/220:20:002
858477991511,3cyclictest951973-21kworker/u8:3+flush-259:021:40:232
85847799150,13cyclictest1051069-21fwupd22:13:012
858472991512,2cyclictest951973-21kworker/u8:3+events_unbound21:24:551
858472991511,3cyclictest962503-21kworker/u8:2+events_unbound21:14:561
858472991511,3cyclictest951973-21kworker/u8:3+events_unbound21:44:541
858472991511,3cyclictest864112-21kworker/u8:0+events_unbound19:49:301
858472991511,3cyclictest1020062-21kworker/u8:4+flush-259:023:15:161
858465991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:570
858465991512,2cyclictest60350irq/132-enp0s29f1:rx-023:50:230
858465991511,3cyclictest1175199-21kworker/u8:2+flush-259:000:35:190
858465991511,3cyclictest1019848-21kworker/u8:1+events_unbound21:45:190
858480991411,2cyclictest0-21swapper/320:40:003
85847799148,4cyclictest252-21systemd-journal23:45:012
85847799147,6cyclictest1-21systemd23:25:012
858477991411,2cyclictest1136341-21kthreadcore23:35:162
858477991411,2cyclictest1067266-21fschecks_time22:30:132
858477991410,3cyclictest1-21systemd22:25:222
858477991410,2cyclictest490-21dbus-daemon19:45:002
85847799140,13cyclictest0-21swapper/219:35:002
85847299149,3cyclictest931418-21kworker/u8:0-flush-259:020:25:001
858472991410,3cyclictest962503-21kworker/u8:2+events_unbound21:09:041
858472991410,3cyclictest1133478-21kworker/u8:0+flush-259:023:42:231
858465991412,1cyclictest61150irq/133-enp0s29f1:tx-020:30:230
858465991412,1cyclictest60350irq/132-enp0s29f1:rx-023:13:020
858465991412,1cyclictest60350irq/132-enp0s29f1:rx-022:51:560
858465991411,2cyclictest60350irq/132-enp0s29f1:rx-020:20:190
85848099139,3cyclictest1020199-21cut21:45:133
85848099139,2cyclictest0-21swapper/300:15:013
85847799139,3cyclictest1020062-21kworker/u8:4+flush-259:022:35:262
85847799137,4cyclictest252-21systemd-journal23:55:002
85847799137,4cyclictest252-21systemd-journal00:12:112
85847799136,4cyclictest252-21systemd-journal20:25:212
858477991311,1cyclictest0-21swapper/221:15:002
858477991310,2cyclictest1100192-21kthreadcore23:00:192
858472991310,2cyclictest899607-21kworker/u8:1+flush-259:020:05:201
858472991310,2cyclictest1024575-21unixbench_singl21:45:251
858465991310,2cyclictest60350irq/132-enp0s29f1:rx-000:05:330
85848099121,2cyclictest1066745-21awk22:30:013
85847799129,2cyclictest1082557-21cpuspeed_turbos22:45:122
85847799129,2cyclictest1061177-21unixbench_singl22:20:252
85847799127,4cyclictest899607-21kworker/u8:1+flush-259:020:20:172
85848099118,2cyclictest918483-21kthreadcore20:05:193
85848099118,2cyclictest874151-21cpuspeed_turbos19:25:143
85848099117,3cyclictest941697-21kworker/u8:2+flush-259:020:35:003
85848099117,3cyclictest1175199-21kworker/u8:2+flush-259:000:35:273
85847799118,2cyclictest1182515-21cpuspeed_turbos00:25:152
85847799118,2cyclictest0-21swapper/219:10:212
85847799117,3cyclictest1-21systemd00:00:012
85847799117,2cyclictest1-21systemd20:05:012
85847799116,4cyclictest490-21dbus-daemon21:57:202
85847799116,4cyclictest1019848-21kworker/u8:1+flush-259:021:50:182
85847799115,4cyclictest509-21rs:main2
85847799110,9cyclictest1056457-21awk22:20:002
85846599118,2cyclictest1154644-21kworker/u8:3+events_unbound00:00:170
85848099107,2cyclictest0-21swapper/319:30:183
85847799108,1cyclictest858461-21cyclictest20:55:002
85847799107,2cyclictest401ktimers/219:45:202
85847799106,3cyclictest401ktimers/222:50:122
85847799104,4cyclictest252-21systemd-journal20:50:002
85847799100,8cyclictest1003965-21latency_hist21:30:002
8584779997,1cyclictest0-21swapper/219:20:202
8584779984,3cyclictest507-21in:imuxsock00:06:272
8584779980,6cyclictest868713-21cut19:20:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional