You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 16:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Mon Dec 08, 2025 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
506771994032,5cyclictest558273-21latency_hist08:00:000
506781993428,4cyclictest818629-21latency_hist12:10:003
506771993427,5cyclictest698837-21latency_hist10:15:000
506771993228,3cyclictest818648-21kworker/u8:4+flush-259:012:30:170
506781993126,3cyclictest651812-21latency_hist09:30:013
506775993127,3cyclictest2698871-21systemd-journal10:40:001
506771993127,3cyclictest813483-21kworker/u8:2+flush-259:012:15:160
506771993126,3cyclictest2698871-21systemd-journal07:43:430
506779993024,4cyclictest2698871-21systemd-journal11:15:002
506775992923,4cyclictest849542-21latency_hist12:40:001
506781992826,1cyclictest693645-21latency_hist10:10:003
506779992821,5cyclictest579177-21/usr/sbin/munin08:20:152
506771992814,12cyclictest682006-21ntpq09:55:210
506779992721,4cyclictest2698871-21systemd-journal10:50:502
506779992720,2cyclictest776590-21sh11:30:002
506775992721,5cyclictest614708-21ntpq08:50:231
506771992721,4cyclictest532413-21latency_hist07:34:590
506781992622,3cyclictest506729-21kworker/u8:0+flush-259:008:30:193
506781992620,4cyclictest2698871-21systemd-journal08:25:003
506771992622,3cyclictest688075-21gpgv10:05:000
506779992522,2cyclictest714147-21kworker/u8:1+flush-259:011:45:262
506779992521,3cyclictest657008-21kworker/u8:3+events_unbound09:40:012
506779992519,4cyclictest506729-21kworker/u8:0+flush-259:008:04:592
506775992519,4cyclictest2698871-21systemd-journal11:10:011
506781992420,3cyclictest787841-21base6411:40:013
506779992420,3cyclictest579168-21kworker/u8:1+events_unbound09:00:182
506775992420,2cyclictest818648-21kworker/u8:4+flush-259:012:30:161
506781992320,2cyclictest492-21dbus-daemon10:05:003
506771992318,3cyclictest579202-21apt-get08:20:120
506771992317,5cyclictest813895-21diskstats12:05:170
506781992217,4cyclictest621025-21kworker/u8:3+flush-259:009:10:263
506779992218,3cyclictest605451-21kworker/u8:4+events_unbound08:45:232
50677599221,19cyclictest1-21systemd11:00:001
506771992217,4cyclictest662383-21/usr/sbin/munin09:40:150
506771992217,4cyclictest641428-21latency_hist09:20:010
506771992216,4cyclictest661262-21ntpq09:35:220
506771992216,4cyclictest2698871-21systemd-journal09:10:030
506781992118,2cyclictest506729-21kworker/u8:0+flush-259:008:40:153
506781992115,4cyclictest719416-21latency_hist10:35:003
506779992117,3cyclictest677925-21kworker/u8:4+flush-259:010:25:002
506779992117,2cyclictest636260-21cron09:15:002
506779992116,3cyclictest506729-21kworker/u8:0+events_unbound07:55:232
50677599214,1cyclictest703989-21munin-plugin-st10:20:001
506775992118,2cyclictest782186-21kworker/u8:0+flush-259:011:40:151
506771992112,1cyclictest60650irq/133-enp0s29f1:rx-011:25:550
506781992017,2cyclictest714147-21kworker/u8:1+flush-259:011:30:153
506781992016,3cyclictest646210-21kworker/u8:2+flush-259:010:45:193
506781992015,3cyclictest563403-21kworker/u8:2+flush-259:008:05:183
506779992015,4cyclictest579168-21kworker/u8:1+flush-259:009:05:152
506779992014,4cyclictest652051-21/usr/sbin/munin09:30:152
506775992017,2cyclictest698836-21sh10:15:001
506775992017,2cyclictest453585-21kworker/u8:4+flush-259:007:10:171
506771992015,4cyclictest745925-21/usr/sbin/munin11:00:180
506771992014,5cyclictest650961-21ntpq09:25:230
506771992014,4cyclictest813460-21latency_hist12:05:000
50677199200,18cyclictest724622-21unin-run10:40:010
506779991916,2cyclictest719408-21idleruntime-cro10:35:002
506779991916,2cyclictest579168-21kworker/u8:1+flush-259:008:35:262
506779991915,3cyclictest813483-21kworker/u8:2+flush-259:012:25:152
506779991914,4cyclictest766285-21kworker/u8:2+flush-259:011:25:012
506779991913,4cyclictest839432-21/usr/sbin/munin12:30:152
506779991913,4cyclictest677925-21kworker/u8:4+events_unbound10:35:192
506779991913,4cyclictest542954-21/usr/sbin/munin07:45:142
506775991915,3cyclictest729977-21kworker/u8:0+flush-259:010:50:171
506775991914,3cyclictest777047-21cp11:30:011
506771991914,4cyclictest2698871-21systemd-journal11:00:000
506771991912,5cyclictest755083-21ntpq11:05:210
506781991815,2cyclictest0-21swapper/309:00:003
506781991812,4cyclictest813483-21kworker/u8:2+flush-259:012:20:253
506779991815,2cyclictest766241-21cron11:20:002
506775991814,3cyclictest506729-21kworker/u8:0+flush-259:007:35:161
506775991813,4cyclictest595128-21/usr/sbin/munin08:35:131
506775991813,4cyclictest453585-21kworker/u8:4+flush-259:008:15:161
506775991813,4cyclictest453585-21kworker/u8:4+flush-259:008:15:161
506771991813,4cyclictest60650irq/133-enp0s29f1:rx-010:48:140
506771991812,4cyclictest839198-21latency_hist12:30:010
506781991714,2cyclictest3002-21cron09:25:003
506779991713,3cyclictest636319-21kworker/u8:0+events_unbound09:50:002
506779991711,4cyclictest677925-21kworker/u8:4+flush-259:010:45:272
506775991714,1cyclictest0-21swapper/110:45:001
506775991712,3cyclictest2698871-21systemd-journal08:45:001
506771991715,1cyclictest0-21swapper/011:40:000
506771991714,2cyclictest61450irq/134-enp0s29f1:tx-008:25:140
506771991714,2cyclictest60650irq/133-enp0s29f1:rx-010:50:160
506771991714,2cyclictest60650irq/133-enp0s29f1:rx-007:35:160
506781991613,2cyclictest756664-21irqcore11:10:173
506781991611,4cyclictest579168-21kworker/u8:1+flush-259:008:35:163
506781991611,4cyclictest553304-21/usr/sbin/munin07:55:173
50677999169,5cyclictest834054-21latency_hist12:25:002
506779991612,3cyclictest688711-21kworker/u8:3+flush-259:010:10:182
506779991612,3cyclictest662373-21kworker/u8:4+flush-259:009:40:162
506779991611,4cyclictest787325-21apt-get11:40:022
506779991611,4cyclictest636319-21kworker/u8:0+flush-259:009:25:182
506779991610,4cyclictest818648-21kworker/u8:4+events_unbound12:10:162
506775991611,4cyclictest713455-21ntpq10:25:241
506775991610,5cyclictest2698871-21systemd-journal09:15:001
506771991614,1cyclictest60650irq/133-enp0s29f1:rx-010:30:240
506771991613,2cyclictest799337-21kthreadcore11:50:180
506771991611,1cyclictest60650irq/133-enp0s29f1:rx-011:31:510
50677199160,2cyclictest823791-21munin-run12:15:000
506781991512,2cyclictest667314-21sh09:45:013
506781991511,3cyclictest527262-21sh07:30:003
506781991511,3cyclictest3000061-21in:imuxsock11:25:003
50677999159,4cyclictest2698871-21systemd-journal08:40:382
50677999158,5cyclictest2698871-21systemd-journal07:55:002
50677999152,9cyclictest578946-21awk08:20:002
50677999152,9cyclictest578946-21awk08:19:592
50677999151,3cyclictest792858-21awk11:45:002
506779991512,2cyclictest636955-21irqcore09:15:192
506779991512,2cyclictest0-21swapper/211:10:002
506779991512,1cyclictest0-21swapper/207:20:012
506779991511,3cyclictest677925-21kworker/u8:4+flush-259:009:55:252
506779991511,3cyclictest572804-21ntp_kernel_err08:10:182
506779991510,3cyclictest614951-21kworker/u8:2+flush-259:008:55:252
506775991513,1cyclictest0-21swapper/109:25:001
506775991512,2cyclictest605451-21kworker/u8:4+flush-259:008:45:181
506775991512,2cyclictest3002-21cron10:05:001
506775991511,3cyclictest813932-21fschecks_count12:05:171
506771991514,1cyclictest60650irq/133-enp0s29f1:rx-008:04:150
506771991513,1cyclictest60650irq/133-enp0s29f1:rx-011:45:190
506771991513,1cyclictest60650irq/133-enp0s29f1:rx-008:55:180
506771991513,1cyclictest60650irq/133-enp0s29f1:rx-007:45:230
506771991513,1cyclictest0-21swapper/009:50:000
506771991512,2cyclictest791859-21needreboot11:40:210
506771991512,2cyclictest61450irq/134-enp0s29f1:tx-010:25:190
506771991511,2cyclictest0-21swapper/011:25:000
506771991510,4cyclictest572844-21ntpq08:10:180
506781991411,2cyclictest517040-21sh07:20:013
506781991410,2cyclictest0-21swapper/311:05:003
50677999149,3cyclictest719647-21kworker/u8:3+flush-259:012:00:002
506779991411,2cyclictest0-21swapper/212:35:252
506779991410,3cyclictest636319-21kworker/u8:0+flush-259:009:50:012
506779991410,2cyclictest0-21swapper/211:00:232
50677599149,4cyclictest548187-21apt-get07:50:131
50677599143,3cyclictest3000061-21in:imuxsock08:05:001
506775991411,2cyclictest453585-21kworker/u8:4+flush-259:007:25:261
50677199149,1cyclictest60650irq/133-enp0s29f1:rx-011:10:210
506771991413,1cyclictest60650irq/133-enp0s29f1:rx-012:20:280
506771991413,1cyclictest60650irq/133-enp0s29f1:rx-010:20:140
506771991413,1cyclictest60650irq/133-enp0s29f1:rx-010:15:280
506771991413,1cyclictest60650irq/133-enp0s29f1:rx-007:50:180
506771991411,2cyclictest60650irq/133-enp0s29f1:rx-009:05:150
506771991410,3cyclictest672783-21apt-get09:50:120
506771991410,3cyclictest2698871-21systemd-journal12:38:560
50677199140,2cyclictest522135-21turbostat07:25:000
50678199139,3cyclictest797699-21journal-offline11:45:563
50678199139,3cyclictest741017-21fschecks_time10:55:153
50678199139,2cyclictest839869-21tr12:30:183
50678199138,4cyclictest719647-21kworker/u8:3+flush-259:012:00:173
50678199136,6cyclictest0-21swapper/309:55:033
506781991310,2cyclictest776105-21unixbench_multi11:25:263
506781991310,1cyclictest0-21swapper/310:20:223
50677999139,2cyclictest0-21swapper/212:09:592
50677999138,3cyclictest506729-21kworker/u8:0+flush-259:007:30:212
506779991310,2cyclictest801425-21kthreadcore11:50:192
506779991310,2cyclictest729248-21unixbench_multi10:40:262
50677599139,3cyclictest766525-21apt-get11:20:121
50677599138,3cyclictest3000063-21rs:main1
50677599131,2cyclictest583187-21ntpq08:20:211
506775991310,2cyclictest750332-21unixbench_multi11:00:281
506775991310,2cyclictest640956-21unixbench_multi09:15:271
506775991310,2cyclictest625010-21cut09:00:221
506775991310,2cyclictest615926-21cpuspeed_turbos08:55:141
506775991310,2cyclictest593881-21needreboot08:30:221
506775991310,2cyclictest569218-21irqcore08:10:141
506775991310,2cyclictest0-21swapper/111:40:011
506771991312,1cyclictest60650irq/133-enp0s29f1:rx-009:31:380
506771991312,1cyclictest60650irq/133-enp0s29f1:rx-009:20:190
506771991312,1cyclictest60650irq/133-enp0s29f1:rx-009:02:000
506771991312,1cyclictest60650irq/133-enp0s29f1:rx-008:50:270
506771991311,2cyclictest60650irq/133-enp0s29f1:rx-007:27:080
506771991311,1cyclictest60650irq/133-enp0s29f1:rx-011:55:170
506771991311,1cyclictest60650irq/133-enp0s29f1:rx-008:35:240
506771991310,2cyclictest60650irq/133-enp0s29f1:rx-007:10:220
506771991310,2cyclictest600550-21fschecks_count08:40:140
50678199129,2cyclictest507390-21irqcore07:10:163
50678199129,2cyclictest0-21swapper/310:15:003
506781991210,1cyclictest0-21swapper/312:40:003
506781991210,1cyclictest0-21swapper/307:39:593
50677599129,2cyclictest808721-21cpuspeed_turbos12:00:151
50677599129,2cyclictest718405-21needreboot10:30:201
50677599129,2cyclictest646210-21kworker/u8:2+flush-259:009:55:001
50677599128,3cyclictest818648-21kworker/u8:4+flush-259:012:10:241
50677599128,3cyclictest563403-21kworker/u8:2+flush-259:008:05:261
50677599125,5cyclictest2698871-21systemd-journal08:30:001
506775991210,1cyclictest0-21swapper/109:50:001
50677199129,1cyclictest0-21swapper/010:40:190
506771991210,1cyclictest60650irq/133-enp0s29f1:rx-007:16:330
50678199119,1cyclictest0-21swapper/310:55:003
50678199118,1cyclictest0-21swapper/308:10:113
50678199117,3cyclictest699081-21/usr/sbin/munin10:15:263
50678199116,3cyclictest661794-21sshd09:35:563
50677999118,2cyclictest688807-21cpuspeed_turbos10:05:152
50677999118,2cyclictest585814-21kthreadcore08:25:142
50677999118,2cyclictest0-21swapper/210:00:142
50677599119,1cyclictest0-21swapper/110:50:001
50677599119,1cyclictest0-21swapper/109:35:001
50677599118,2cyclictest828956-21systemd-run12:19:591
50677599118,2cyclictest527739-21fschecks_count07:30:131
50677599114,1cyclictest651819-21basename09:30:001
50677199119,2cyclictest60650irq/133-enp0s29f1:rx-010:05:230
50677199119,2cyclictest60650irq/133-enp0s29f1:rx-008:33:520
50677199119,1cyclictest60650irq/133-enp0s29f1:rx-011:19:000
50677199119,1cyclictest60650irq/133-enp0s29f1:rx-008:15:250
50677199119,1cyclictest60650irq/133-enp0s29f1:rx-008:15:250
50677199118,2cyclictest609948-21unixbench_multi08:45:270
50678199107,2cyclictest656523-21unixbench_multi09:30:253
50677599100,4cyclictest776586-21awk11:30:001
50677599100,3cyclictest798053-21latency_hist11:50:021
50677199108,1cyclictest60650irq/133-enp0s29f1:rx-008:05:250
5067819996,2cyclictest0-21swapper/308:50:003
5067759991,1cyclictest191rcu_preempt12:20:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional