You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 06:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Dec 08, 2025 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
996361994741,4cyclictest1146590-21latency_hist21:35:012
996366994540,4cyclictest1281682-21gpgv23:45:013
996356993834,3cyclictest1058741-21kworker/u8:1+flush-259:020:15:200
996356993226,4cyclictest1338714-21latency_hist00:39:590
996361993121,9cyclictest963970-21kworker/u8:2+flush-259:019:15:262
996356993126,3cyclictest1255427-21latency_hist23:20:010
996356993126,3cyclictest1058741-21kworker/u8:1+flush-259:020:35:180
996358993026,3cyclictest1017374-21kworker/u8:1+flush-259:019:40:001
996356993026,3cyclictest1249893-21kworker/u8:1+flush-259:023:30:190
996361992924,4cyclictest1317753-21apt-get00:17:002
996361992922,5cyclictest2698871-21systemd-journal22:00:012
996361992824,3cyclictest1141451-21kworker/u8:0+flush-259:021:50:172
996358992824,3cyclictest963970-21kworker/u8:2+flush-259:020:32:191
996358992822,4cyclictest1033028-21/usr/sbin/munin19:45:141
996356992825,2cyclictest1058741-21kworker/u8:1+flush-259:020:14:590
996356992720,5cyclictest1140529-21ntpq21:25:220
996361992620,4cyclictest1012453-21/usr/sbin/munin19:25:272
996361992618,5cyclictest1218560-21latency_hist22:45:002
996361992517,6cyclictest1141426-21latency_hist21:30:002
996356992519,4cyclictest1084309-21latency_hist20:35:010
996366992420,3cyclictest1115971-21apt-get21:05:163
996366992418,4cyclictest3000063-21rs:main3
996366992317,4cyclictest1063642-21latency_hist20:15:013
996361992319,3cyclictest1058741-21kworker/u8:1+flush-259:020:20:192
996361992318,4cyclictest1249893-21kworker/u8:1+flush-259:023:30:012
996356992319,3cyclictest1146818-21kworker/u8:2+flush-259:021:40:010
996356992317,4cyclictest1203149-21latency_hist22:30:000
996366992217,3cyclictest1126246-21/usr/sbin/munin21:15:163
996366992216,4cyclictest2698871-21systemd-journal00:10:013
996366992215,4cyclictest1223723-21latency_hist22:50:003
996356992219,2cyclictest1287159-21sh23:50:000
996356992218,3cyclictest1249893-21kworker/u8:1+flush-259:023:25:010
996356992217,3cyclictest1156864-21kworker/u8:3+flush-259:022:40:190
996356992216,5cyclictest1176561-21ntpq22:00:220
996356992216,4cyclictest1222817-21ntpq22:45:220
996366992118,2cyclictest0-21swapper/321:15:003
996366992117,3cyclictest1234003-21gpgv23:00:003
996366992117,3cyclictest1234003-21gpgv22:59:593
996366992115,4cyclictest1250713-21diskstats23:15:153
996361992117,3cyclictest1001641-21kworker/u8:3+flush-259:020:05:272
996361992115,4cyclictest1266372-21apt-get23:30:132
996361992115,4cyclictest1192861-21latency_hist22:20:002
996358992114,5cyclictest1308140-21diskstats00:10:121
996356992118,2cyclictest0-21swapper/021:55:010
996356992117,3cyclictest1292294-21kworker/u8:0+events_unbound00:05:150
996356992117,3cyclictest1156864-21kworker/u8:3+events_unbound22:15:150
996356992116,4cyclictest963970-21kworker/u8:2+events_unbound19:35:190
996366992016,3cyclictest1323512-21apt-get00:25:153
996361992017,2cyclictest963970-21kworker/u8:2+flush-259:019:55:182
996361992017,2cyclictest1037949-21kworker/u8:0+flush-259:020:05:002
996361992016,3cyclictest1292294-21kworker/u8:0+flush-259:000:00:262
996361992014,4cyclictest1068786-21latency_hist20:20:002
996358992017,2cyclictest1001449-21systemd-run19:15:011
996358992016,3cyclictest1323487-21/usr/sbin/munin00:25:181
996358992014,4cyclictest1302605-21latency_hist00:05:011
996356992016,2cyclictest1244514-21kworker/u8:2+flush-259:023:10:240
996356992014,4cyclictest1115598-21kworker/u8:1+flush-259:021:15:190
996356992014,4cyclictest1017354-21latency_hist19:30:010
996366991912,5cyclictest1150815-21ntpq21:35:203
996361991916,2cyclictest963970-21kworker/u8:2+flush-259:019:35:262
996361991916,2cyclictest1303886-21kthreadcore00:05:182
996361991915,3cyclictest1244514-21kworker/u8:2+events_unbound23:45:172
996361991915,2cyclictest0-21swapper/223:05:002
996358991915,3cyclictest963970-21kworker/u8:2+flush-259:020:50:181
996358991913,5cyclictest1197111-21ntpq22:20:231
996358991912,5cyclictest1115704-21latency_hist21:05:011
996356991916,2cyclictest1071436-21kthreadcore20:20:200
996356991915,3cyclictest1292294-21kworker/u8:0+events_unbound00:30:230
996356991913,4cyclictest1047307-21ntpq19:55:230
996366991815,2cyclictest1266090-21cron23:30:003
996361991816,1cyclictest0-21swapper/223:15:002
996361991815,2cyclictest1333553-21idleruntime-cro00:35:012
996361991815,2cyclictest1183252-21irqcore22:10:172
996361991813,4cyclictest1043042-21latency_hist19:55:012
996361991811,5cyclictest1202267-21ntpq22:25:232
996358991814,3cyclictest1234035-21kworker/u8:1+flush-259:023:05:261
996358991812,4cyclictest1234094-21gpgv23:00:001
996358991812,4cyclictest1234094-21gpgv23:00:001
996356991815,2cyclictest963970-21kworker/u8:2+flush-259:020:45:000
996356991813,4cyclictest2698871-21systemd-journal23:06:350
996356991812,4cyclictest1313288-21diskstats00:15:160
996356991812,4cyclictest1265190-21ntpq23:25:220
996366991714,2cyclictest1007018-21cron19:20:013
996366991711,4cyclictest2698871-21systemd-journal19:29:153
996366991711,4cyclictest1156849-21latency_hist21:45:003
996361991715,1cyclictest1213381-21kworker/u8:0+events_unbound22:50:202
996358991713,3cyclictest1249893-21kworker/u8:1+flush-259:023:55:151
996358991712,4cyclictest1234035-21kworker/u8:1+flush-259:023:00:171
996356991714,2cyclictest60650irq/133-enp0s29f1:rx-019:24:270
996356991713,3cyclictest1156864-21kworker/u8:3+events_unbound22:20:160
996366991612,3cyclictest1223988-21apt-get22:50:133
996366991610,4cyclictest1161134-21ntpq21:45:233
996361991614,1cyclictest0-21swapper/222:30:212
996361991613,2cyclictest1219237-21irqcore22:45:182
996361991612,2cyclictest0-21swapper/200:00:012
996361991610,4cyclictest1162008-21latency_hist21:50:012
996358991613,2cyclictest963970-21kworker/u8:2+events_unbound19:55:201
996358991612,3cyclictest1244514-21kworker/u8:2+flush-259:023:25:261
996358991612,2cyclictest1168396-21kthreadcore21:55:181
996358991611,3cyclictest1115598-21kworker/u8:1+flush-259:021:15:181
99635699169,5cyclictest2698871-21systemd-journal22:39:590
996356991614,1cyclictest60650irq/133-enp0s29f1:rx-000:10:180
996356991613,2cyclictest60650irq/133-enp0s29f1:rx-022:10:300
996356991613,2cyclictest1244514-21kworker/u8:2+events_unbound23:50:220
996356991612,3cyclictest963970-21kworker/u8:2+flush-259:020:05:260
996356991612,3cyclictest1244514-21kworker/u8:2+events_unbound23:35:250
996356991612,3cyclictest1244514-21kworker/u8:2+events_unbound00:00:000
996356991612,3cyclictest1104997-21kworker/u8:0+events_unbound21:20:220
996356991611,4cyclictest1115598-21kworker/u8:1+flush-259:021:05:010
996356991611,3cyclictest492-21dbus-daemon00:30:010
996356991611,3cyclictest1213381-21kworker/u8:0+flush-259:022:54:590
99636699159,4cyclictest1276430-21latency_hist23:40:013
99636699159,4cyclictest1260743-21base6423:25:003
99636699158,4cyclictest0-21swapper/322:29:073
99636699155,1cyclictest0-21swapper/322:20:223
99636699153,8cyclictest50-21ksoftirqd/300:35:223
996366991513,1cyclictest61750irq/140-enp0s29f1:tx-323:55:133
996366991513,1cyclictest0-21swapper/319:25:003
996366991512,2cyclictest0-21swapper/320:55:013
996366991512,2cyclictest0-21swapper/300:35:013
996366991510,3cyclictest2698871-21systemd-journal20:05:143
99636699150,13cyclictest1-21systemd00:19:223
99636199159,4cyclictest1318488-21diskstats00:20:132
99635899159,4cyclictest1208733-21diskstats22:35:141
996358991512,2cyclictest1157526-21irqcore21:45:181
996358991512,2cyclictest1110548-21sh21:00:001
996358991511,3cyclictest1281591-21gpgv23:45:011
996358991511,3cyclictest1058776-21apt-get20:10:151
996358991511,3cyclictest1001641-21kworker/u8:3+flush-259:020:20:281
99635699155,8cyclictest2698871-21systemd-journal23:04:590
996356991513,2cyclictest60650irq/133-enp0s29f1:rx-022:09:430
996356991513,1cyclictest60650irq/133-enp0s29f1:rx-019:45:190
996356991512,2cyclictest60650irq/133-enp0s29f1:rx-023:40:130
996356991512,2cyclictest60650irq/133-enp0s29f1:rx-020:50:170
996356991512,2cyclictest60650irq/133-enp0s29f1:rx-019:10:300
996356991512,2cyclictest1156864-21kworker/u8:3+events_unbound22:30:180
996356991511,3cyclictest1145749-21ntp_offset21:30:240
996356991511,3cyclictest1115598-21kworker/u8:1+flush-259:021:05:220
996356991511,3cyclictest1017374-21kworker/u8:1+flush-259:019:30:210
99635699151,12cyclictest1-21systemd20:03:140
99636699148,4cyclictest1136289-21latency_hist21:25:013
99636699145,1cyclictest191rcu_preempt21:55:263
99636699143,1cyclictest0-21swapper/320:30:173
99636699142,2cyclictest1078249-21ntpq20:25:223
99636699141,3cyclictest50-21ksoftirqd/323:00:223
99636699141,3cyclictest1110547-21awk21:00:003
996366991411,2cyclictest835-21runrttasks23:09:593
996366991411,1cyclictest191rcu_preempt20:04:223
996361991412,1cyclictest1260891-21wc23:25:012
996361991412,1cyclictest0-21swapper/221:20:012
996361991411,2cyclictest1104997-21kworker/u8:0+flush-259:021:20:182
996361991410,3cyclictest963970-21kworker/u8:2+events_unbound19:45:172
996361991410,3cyclictest1244514-21kworker/u8:2+flush-259:023:40:012
996358991410,3cyclictest1250724-21fschecks_count23:15:141
996358991410,3cyclictest1017374-21kworker/u8:1+flush-259:019:40:171
99635699149,3cyclictest1073966-21kworker/u8:5+events_unbound20:45:210
996356991412,1cyclictest60650irq/133-enp0s29f1:rx-021:10:260
996356991412,1cyclictest60650irq/133-enp0s29f1:rx-020:55:180
996356991411,2cyclictest1302115-21unixbench_multi00:00:280
99636699136,4cyclictest0-21swapper/322:11:123
99636699132,3cyclictest50-21ksoftirqd/322:30:233
99636699132,2cyclictest1140575-21ntpq21:25:223
99636699131,3cyclictest50-21ksoftirqd/320:45:193
99636699131,2cyclictest1191960-21ntpq22:15:213
996366991310,1cyclictest191rcu_preempt19:47:433
99636199139,3cyclictest503-21systemd-logind22:40:002
99636199139,2cyclictest0-21swapper/200:30:002
99636199138,4cyclictest996561-21apt-get19:10:142
996361991310,2cyclictest1156846-21idleruntime-cro21:45:012
99635899136,5cyclictest1078334-21ntpq20:25:231
996358991311,1cyclictest0-21swapper/100:10:011
996358991310,2cyclictest1068783-21cron20:19:591
99635699137,4cyclictest2698871-21systemd-journal20:26:170
996356991311,1cyclictest60650irq/133-enp0s29f1:rx-021:56:440
996356991311,1cyclictest60650irq/133-enp0s29f1:rx-021:48:040
99636699129,2cyclictest1322764-21unixbench_multi00:20:253
99636699129,2cyclictest1249384-21unixbench_multi23:10:243
99636699129,2cyclictest0-21swapper/322:05:013
99636699125,1cyclictest191rcu_preempt20:20:153
99636699124,1cyclictest191rcu_preempt00:10:123
99636699123,6cyclictest0-21swapper/322:05:163
99636699121,3cyclictest50-21ksoftirqd/323:45:163
99636699121,3cyclictest50-21ksoftirqd/319:40:213
99636699121,3cyclictest50-21ksoftirqd/319:10:273
99636699121,2cyclictest50-21ksoftirqd/321:30:183
99636699121,2cyclictest1110968-21diskstats21:00:143
99636699121,2cyclictest1021683-21ntpq19:30:273
99636699120,7cyclictest1090097-21hddtemp_smartct20:40:193
99636699120,7cyclictest1026715-21ntpq19:35:213
99636699120,4cyclictest1287401-21/usr/sbin/munin23:50:133
99636699120,2cyclictest1166190-21ntpq21:50:213
99636199129,2cyclictest1334850-21kthreadcore00:35:182
99636199129,2cyclictest1198003-21sh22:25:002
99636199129,1cyclictest0-21swapper/219:20:142
99636199128,3cyclictest1019920-21kthreadcore19:30:212
99636199121,10cyclictest1233962-21cron23:00:002
99636199121,10cyclictest1233962-21cron22:59:592
996361991210,1cyclictest0-21swapper/223:15:132
99635899129,2cyclictest1228851-21idleruntime-cro22:54:591
99635899129,2cyclictest1223713-21idleruntime-cro22:50:001
99635899129,1cyclictest0-21swapper/120:45:001
99635899129,1cyclictest0-21swapper/120:00:161
99635899128,3cyclictest1115598-21kworker/u8:1+flush-259:021:30:181
99636699113,4cyclictest50-21ksoftirqd/322:40:153
996366991110,0cyclictest0-21swapper/320:35:233
99636699110,6cyclictest1043473-21diskstats19:55:163
99636199119,1cyclictest0-21swapper/220:45:142
99636199119,1cyclictest0-21swapper/220:10:162
99636199118,2cyclictest1281569-21sh23:45:002
99636199118,2cyclictest1147023-21fschecks_count21:35:142
99636199118,2cyclictest0-21swapper/200:15:002
99635899119,1cyclictest0-21swapper/121:20:191
99635899118,2cyclictest1260139-21unixbench_singl23:20:261
99635899118,2cyclictest1055908-21kthreadcore20:05:201
99635899118,2cyclictest1017883-21fschecks_time19:30:171
99635899117,3cyclictest1176570-21ntp_kernel_pll_22:00:221
99635899115,4cyclictest1125149-21ntpq21:10:231
99635699119,1cyclictest60650irq/133-enp0s29f1:rx-022:55:180
99635699119,1cyclictest60650irq/133-enp0s29f1:rx-022:55:180
99635699119,1cyclictest60650irq/133-enp0s29f1:rx-019:40:150
99635699118,2cyclictest60650irq/133-enp0s29f1:rx-019:53:320
99635699118,2cyclictest60650irq/133-enp0s29f1:rx-019:15:160
99636199108,1cyclictest0-21swapper/220:30:172
99636199107,2cyclictest1078194-21cut20:25:212
99636199106,2cyclictest1243866-21ntpq23:05:272
99636199105,3cyclictest1116795-21sed21:05:212
99636199100,2cyclictest1094654-21latency_hist20:45:002
99635899108,1cyclictest0-21swapper/119:15:161
99635899107,2cyclictest1182046-21kworker/u8:2+flush-259:022:29:591
99635899106,3cyclictest1328646-21apt-get00:30:101
9963589997,1cyclictest1095010-21cpuspeed_turbos20:45:151
9963589995,3cyclictest1146903-21awk21:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional