You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-20 - 09:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Sat Dec 20, 2025 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
864082994339,3cyclictest1066177-21kworker/u8:0+flush-259:022:45:212
864082994239,2cyclictest983466-21kworker/u8:2+events_unbound21:05:242
864077994135,4cyclictest973170-21latency_hist20:55:000
864082994037,2cyclictest1117976-21kworker/u8:4+events_unbound23:25:222
864079994036,3cyclictest1154309-21/usr/sbin/munin23:50:211
864082993936,2cyclictest878679-21kworker/u8:2+flush-259:019:30:162
864082993933,2cyclictest878679-21kworker/u8:2+events_unbound20:05:252
864082993834,3cyclictest1055899-21kworker/u8:1+events_unbound22:40:232
864079993832,4cyclictest904428-21ntpq19:45:231
864082993734,2cyclictest900270-21kworker/u8:4+flush-259:020:25:212
864077993633,2cyclictest983466-21kworker/u8:2+events_unbound21:10:240
864082993532,2cyclictest1138804-21kworker/u8:0+events_unbound00:00:242
864082993531,3cyclictest983466-21kworker/u8:2+events_unbound21:15:242
864079993530,4cyclictest878679-21kworker/u8:2+flush-259:020:10:011
864077993530,3cyclictest1159514-21apt-get23:55:110
864082993431,2cyclictest952185-21kworker/u8:1+events_unbound20:55:172
864082993431,2cyclictest910455-21kworker/u8:5+events_unbound20:05:002
864082993430,3cyclictest925981-21kworker/u8:1+events_unbound20:20:242
864082993430,3cyclictest1055899-21kworker/u8:1+events_unbound22:30:222
864082993428,2cyclictest1076724-21kworker/u8:2+events_unbound22:50:192
864077993431,2cyclictest1025043-21kworker/u8:0+events_unbound21:45:250
864082993330,2cyclictest999004-21kworker/u8:3+events_unbound21:45:012
864082993330,2cyclictest878679-21kworker/u8:2+events_unbound19:50:202
864082993229,2cyclictest983466-21kworker/u8:2+events_unbound21:25:212
864082993229,2cyclictest1004402-21kworker/u8:4+events_unbound21:55:212
864079993226,4cyclictest1030200-21/usr/sbin/munin21:50:201
864077993228,3cyclictest952185-21kworker/u8:1+flush-259:020:45:000
864077993228,3cyclictest1055899-21kworker/u8:1+flush-259:022:20:210
864082993128,2cyclictest900270-21kworker/u8:4+flush-259:019:55:162
864082993128,2cyclictest1102334-21kworker/u8:1+events_unbound23:20:122
864082993128,2cyclictest1102334-21kworker/u8:1+events_unbound00:05:212
864082993128,2cyclictest1066177-21kworker/u8:0+events_unbound22:55:192
864077993128,2cyclictest1138804-21kworker/u8:0+flush-259:000:15:210
864077993127,3cyclictest1095638-21kworker/u8:3+flush-259:022:50:200
864077993127,3cyclictest1014976-21kworker/u8:1+flush-259:021:40:210
864082993027,2cyclictest1076724-21kworker/u8:2+events_unbound23:00:162
864079993023,6cyclictest1117092-21ntpq23:10:221
864077993027,2cyclictest1066177-21kworker/u8:0+events_unbound22:45:130
864082992926,2cyclictest859122-21kworker/u8:3+events_unbound19:20:112
864082992926,2cyclictest1102334-21kworker/u8:1+flush-259:023:10:212
864082992926,2cyclictest1004402-21kworker/u8:4+events_unbound21:50:212
864082992922,3cyclictest900270-21kworker/u8:4+flush-259:019:45:162
864079992925,3cyclictest1117976-21kworker/u8:4+flush-259:023:30:001
864082992825,2cyclictest1123365-21kworker/u8:2+flush-259:023:30:212
864082992825,2cyclictest1102334-21kworker/u8:1+flush-259:023:35:242
864082992825,2cyclictest1102334-21kworker/u8:1+flush-259:023:35:242
864082992825,2cyclictest1066177-21kworker/u8:0+events_unbound22:35:242
864079992822,4cyclictest825862-21kworker/u8:2+flush-259:019:10:151
864079992820,5cyclictest1054757-21ntpq22:10:221
864077992825,2cyclictest835678-21kworker/u8:1+flush-259:019:30:200
864077992825,2cyclictest1025043-21kworker/u8:0+events_unbound22:15:010
864077992824,3cyclictest1066177-21kworker/u8:0+events_unbound22:35:220
864077992824,3cyclictest1004402-21kworker/u8:4+events_unbound21:55:130
864077992822,4cyclictest957327-21latency_hist20:40:000
864082992724,2cyclictest973189-21kworker/u8:3+events_unbound21:00:212
864082992724,2cyclictest1138804-21kworker/u8:0+events_unbound00:25:142
864082992723,3cyclictest878679-21kworker/u8:2+flush-259:020:45:192
864079992722,3cyclictest1055899-21kworker/u8:1+flush-259:022:40:181
864087992621,3cyclictest252-21systemd-journal20:54:103
864082992623,2cyclictest925981-21kworker/u8:1+events_unbound20:10:182
864082992622,3cyclictest993357-21kworker/u8:1+events_unbound21:14:592
864079992621,4cyclictest936922-21kworker/u8:0+flush-259:021:10:001
864079992620,4cyclictest1144004-21apt-get23:40:131
864087992520,3cyclictest1138841-21apt-get23:35:133
864087992520,3cyclictest1138841-21apt-get23:35:123
864082992522,2cyclictest1025043-21kworker/u8:0+flush-259:022:00:192
864082992521,3cyclictest1102334-21kworker/u8:1+events_unbound23:05:192
864079992521,3cyclictest1180778-21apt-get00:15:111
864079992519,4cyclictest1185946-21apt-get00:20:131
864077992521,3cyclictest1025043-21kworker/u8:0+events_unbound21:50:130
864087992418,5cyclictest873410-21ntpq19:15:223
864087992418,5cyclictest252-21systemd-journal22:12:103
864087992411,3cyclictest884842-21/usr/sbin/munin19:30:143
864082992422,2cyclictest1170140-21kworker/u8:5+events_unbound00:20:242
864082992421,2cyclictest936922-21kworker/u8:0+events_unbound20:35:132
864082992421,2cyclictest1004402-21kworker/u8:4+events_unbound21:35:222
864079992419,3cyclictest1118219-21apt-get23:15:141
864079992416,5cyclictest1107651-21latency_hist23:05:001
864077992420,3cyclictest1102334-21kworker/u8:1+events_unbound23:10:170
864087992317,4cyclictest1148926-21latency_hist23:45:003
864087992312,2cyclictest923374-21kthreadcore20:05:193
864082992320,2cyclictest1117976-21kworker/u8:4+events_unbound23:50:182
864082992319,3cyclictest925981-21kworker/u8:1+events_unbound20:15:252
864082992318,3cyclictest1065961-21latency_hist22:25:012
864079992318,3cyclictest252-21systemd-journal21:16:101
864079992318,3cyclictest252-21systemd-journal20:51:151
864077992321,1cyclictest1-21systemd23:51:100
864077992320,2cyclictest1170140-21kworker/u8:5+events_unbound00:30:170
864077992320,2cyclictest1102334-21kworker/u8:1+flush-259:023:15:270
864077992319,3cyclictest878679-21kworker/u8:2+flush-259:019:40:120
864077992319,3cyclictest1138804-21kworker/u8:0+events_unbound23:40:170
864077992319,3cyclictest1055899-21kworker/u8:1+flush-259:022:15:210
864077992318,3cyclictest825862-21kworker/u8:2+flush-259:019:10:180
864087992218,3cyclictest931262-21gpgv20:15:013
864087992218,3cyclictest1066177-21kworker/u8:0+flush-259:022:55:003
864082992220,2cyclictest1102334-21kworker/u8:1+flush-259:000:10:192
864082992219,2cyclictest983466-21kworker/u8:2+flush-259:021:20:242
864082992219,2cyclictest983466-21kworker/u8:2+flush-259:021:20:242
864082992219,2cyclictest878679-21kworker/u8:2+flush-259:020:50:232
864082992219,2cyclictest1055899-21kworker/u8:1+flush-259:022:15:232
864079992217,4cyclictest1149188-21apt-get23:45:141
864079992216,4cyclictest1164462-21latency_hist00:00:001
864079992215,5cyclictest1164456-21apt-get00:00:021
864077992218,3cyclictest1170140-21kworker/u8:5+flush-259:000:20:260
864077992218,3cyclictest1123365-21kworker/u8:2+flush-259:023:30:150
864077992217,3cyclictest835678-21kworker/u8:1+flush-259:019:20:210
864082992116,4cyclictest1154073-21latency_hist23:50:012
864079992118,2cyclictest1206298-21cron00:40:001
864079992117,3cyclictest252-21systemd-journal20:45:001
864077992118,2cyclictest967647-21gpgv20:50:000
864077992118,2cyclictest936922-21kworker/u8:0+events_unbound20:30:230
864077992118,2cyclictest1004402-21kworker/u8:4+flush-259:022:25:250
864077992117,3cyclictest925981-21kworker/u8:1+events_unbound20:20:140
864077992117,3cyclictest1138804-21kworker/u8:0+flush-259:023:40:000
864077992117,3cyclictest1138804-21kworker/u8:0+flush-259:023:40:000
864077992117,3cyclictest1117976-21kworker/u8:4+events_unbound23:25:200
864087992016,3cyclictest1191105-21apt-get00:25:123
864087992016,2cyclictest1076724-21kworker/u8:2+flush-259:023:00:203
864082992017,2cyclictest878679-21kworker/u8:2+events_unbound19:35:182
864079992015,3cyclictest1092453-21apt-get22:50:111
864077992016,3cyclictest952185-21kworker/u8:1+flush-259:020:55:200
864082991916,2cyclictest1196205-21kworker/u8:3+events_unbound00:35:152
864082991913,5cyclictest1071541-21latency_hist22:30:012
864079991913,3cyclictest978336-21latency_hist20:59:591
864077991916,2cyclictest835678-21kworker/u8:1+flush-259:019:25:210
864077991915,3cyclictest878679-21kworker/u8:2+events_unbound19:55:010
864077991915,3cyclictest1102334-21kworker/u8:1+flush-259:023:45:210
864077991915,3cyclictest1025043-21kworker/u8:0+events_unbound22:05:200
864087991813,4cyclictest1170121-21latency_hist00:05:003
864082991815,2cyclictest1025043-21kworker/u8:0+events_unbound22:10:192
864082991815,2cyclictest1025043-21kworker/u8:0+events_unbound22:05:242
864082991814,3cyclictest859122-21kworker/u8:3+events_unbound19:17:122
864079991814,3cyclictest925981-21kworker/u8:1+events_unbound20:15:201
864079991813,4cyclictest936961-21apt-get20:20:131
864079991813,4cyclictest1004402-21kworker/u8:4+flush-259:021:30:001
864079991812,4cyclictest878679-21kworker/u8:2+flush-259:019:55:261
864077991815,3cyclictest1190857-21kworker/u8:2+events_unbound00:35:010
864077991815,2cyclictest1154092-21kworker/u8:2+events_unbound00:00:030
864077991815,2cyclictest1117976-21kworker/u8:4+events_unbound00:05:150
864077991813,3cyclictest1175570-21/usr/sbin/munin00:10:150
864087991712,3cyclictest962752-21apt-get20:45:113
86408799170,15cyclictest1164543-21munin-run00:00:003
864082991714,2cyclictest835678-21kworker/u8:1+events_unbound19:11:122
864079991714,2cyclictest503-21tpm2-abrmd23:10:001
864079991712,4cyclictest946124-21ntpq20:25:201
864077991714,2cyclictest925981-21kworker/u8:1+events_unbound20:16:100
864077991714,2cyclictest1076724-21kworker/u8:2+events_unbound23:00:220
864077991713,3cyclictest1066177-21kworker/u8:0+events_unbound22:40:030
864077991712,4cyclictest1112805-21latency_hist23:10:010
864077991712,4cyclictest1066177-21kworker/u8:0+flush-259:022:31:000
864087991612,3cyclictest1066177-21kworker/u8:0+flush-259:022:30:273
864087991610,4cyclictest1201463-21/usr/sbin/munin00:35:143
864082991613,3cyclictest1154092-21kworker/u8:2+flush-259:023:55:152
864082991612,3cyclictest936922-21kworker/u8:0+events_unbound20:30:322
864082991612,3cyclictest883732-21ntp_kernel_pll_19:25:222
864082991612,3cyclictest878679-21kworker/u8:2+events_unbound20:41:142
86407999169,5cyclictest1066142-21cp22:25:011
864079991612,3cyclictest252-21systemd-journal19:25:591
864079991610,5cyclictest1133679-21apt-get23:30:121
864077991614,1cyclictest999004-21kworker/u8:3+flush-259:021:35:150
864077991614,1cyclictest60350irq/132-enp0s29f1:rx-021:30:160
864077991614,1cyclictest1123404-21apt-get23:20:130
864077991613,3cyclictest835678-21kworker/u8:1+events_unbound19:15:190
864077991613,2cyclictest900270-21kworker/u8:4+flush-259:019:45:260
864077991612,3cyclictest1066177-21kworker/u8:0+flush-259:022:55:210
864087991513,2cyclictest864071-21cyclictest22:49:593
864087991512,2cyclictest1123119-21cron23:20:003
864087991512,2cyclictest1066176-21apt-key22:25:013
864087991511,2cyclictest1177902-21kthreadcore00:10:183
864087991510,3cyclictest952185-21kworker/u8:1+flush-259:020:55:183
864082991512,2cyclictest859122-21kworker/u8:3+flush-259:019:40:592
864082991512,2cyclictest1004402-21kworker/u8:4+flush-259:021:49:362
864082991511,3cyclictest1102334-21kworker/u8:1+events_unbound00:18:062
86407999159,4cyclictest895166-21apt-get19:40:121
86407999159,4cyclictest1071787-21/usr/sbin/munin22:30:211
864079991511,3cyclictest931590-21latency_hist20:15:011
864079991510,3cyclictest1004402-21kworker/u8:4+flush-259:021:35:261
86407799157,1cyclictest925969-21turbostat20:10:010
864077991513,1cyclictest60350irq/132-enp0s29f1:rx-021:05:180
864077991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:120
864077991513,1cyclictest60350irq/132-enp0s29f1:rx-019:35:270
864077991512,2cyclictest936922-21kworker/u8:0+flush-259:021:25:000
864077991512,2cyclictest936922-21kworker/u8:0+flush-259:021:24:590
864077991512,2cyclictest900270-21kworker/u8:4+events_unbound20:04:570
864077991512,2cyclictest60350irq/132-enp0s29f1:rx-022:00:200
864077991512,2cyclictest60350irq/132-enp0s29f1:rx-000:25:190
864077991511,3cyclictest983466-21kworker/u8:2+events_unbound21:15:220
86408799149,4cyclictest988663-21latency_hist21:10:013
864087991412,1cyclictest1149608-21irqcore23:45:183
864087991411,2cyclictest934119-21kthreadcore20:15:203
864087991411,2cyclictest0-21swapper/322:05:003
864087991410,3cyclictest1004402-21kworker/u8:4+flush-259:021:55:163
864082991411,2cyclictest1170140-21kworker/u8:5+events_unbound00:34:562
86407999141,6cyclictest1092188-21munin-run22:49:591
864079991411,2cyclictest1029548-21unixbench_singl21:45:251
864079991410,2cyclictest1004402-21kworker/u8:4+flush-259:022:07:151
864077991412,1cyclictest60350irq/132-enp0s29f1:rx-020:12:530
864077991411,2cyclictest900270-21kworker/u8:4+events_unbound19:50:020
86408799139,3cyclictest1066177-21kworker/u8:0+flush-259:022:55:253
86408799139,3cyclictest1004402-21kworker/u8:4+flush-259:021:34:413
86408799138,4cyclictest252-21systemd-journal19:55:003
864087991310,2cyclictest995130-21kthreadcore21:15:183
864087991310,2cyclictest1137612-21cut23:30:203
864087991310,2cyclictest1077017-21cpuspeed_turbos22:35:143
86408299139,3cyclictest1138804-21kworker/u8:0+events_unbound23:40:132
86408299139,3cyclictest1066177-21kworker/u8:0+events_unbound23:16:522
86407999138,4cyclictest874585-21apt-get19:20:101
86407999135,5cyclictest1191266-21diskstats00:25:151
864079991311,1cyclictest1023834-21needreboot21:40:181
864079991310,2cyclictest978668-21cpuspeed_turbos21:00:141
864079991310,2cyclictest890144-21cpuspeed_turbos19:35:161
864079991310,1cyclictest11237092sleep123:20:161
86407799139,3cyclictest983466-21kworker/u8:2+flush-259:021:27:260
864077991310,3cyclictest878679-21kworker/u8:2+events_unbound20:25:020
86408799122,9cyclictest0-21swapper/321:55:003
86408799120,2cyclictest9004512grep19:45:143
86408299128,3cyclictest999004-21kworker/u8:3+events_unbound21:31:462
86407999129,2cyclictest962817-21cpuspeed_turbos20:45:131
86407999129,2cyclictest0-21swapper/122:00:191
86407999129,1cyclictest0-21swapper/121:10:181
86407999127,4cyclictest252-21systemd-journal00:34:211
86407999126,4cyclictest252-21systemd-journal20:38:101
86407999126,4cyclictest252-21systemd-journal19:51:101
86408799118,2cyclictest910898-21fschecks_count19:55:153
86408799118,2cyclictest1107981-21cpuspeed_turbos23:05:123
86408799117,3cyclictest252-21systemd-journal23:24:553
86408799117,3cyclictest1055899-21kworker/u8:1+flush-259:022:29:413
86408799116,4cyclictest947035-21cron20:30:013
86407999117,2cyclictest252-21systemd-journal00:09:551
86407999111,2cyclictest1180505-21awk00:15:011
86408799108,1cyclictest0-21swapper/322:15:183
86408799108,1cyclictest0-21swapper/300:15:153
86407999108,1cyclictest0-21swapper/122:15:251
86407999108,1cyclictest0-21swapper/119:30:171
86407999106,2cyclictest8694372sleep119:15:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional