You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 19:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Mon Nov 17, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24773899562,36cyclictest0-21swapper/010:15:540
24773899453,35cyclictest395053-21sendmail-msp11:25:560
24773899451,29cyclictest448231-21grep12:23:020
247738994421,8cyclictest0-21swapper/010:54:020
24773899432,28cyclictest0-21swapper/012:16:310
247738994322,7cyclictest290112-21/usr/sbin/munin09:18:080
24773899431,37cyclictest0-21swapper/012:29:410
247738994118,2cyclictest0-21swapper/011:32:340
24773899411,2cyclictest0-21swapper/011:42:580
24773899392,10cyclictest346001-21sendmail-msp10:26:010
24773899364,27cyclictest418561-21entropy11:52:580
24774099353,8cyclictest451207-21ssh12:25:592
247740993524,9cyclictest336100-21ssh10:13:192
24773899330,32cyclictest392890-21ntpq11:23:010
247739993210,7cyclictest11050irq/107-eth%d10:52:191
24773899321,24cyclictest0-21swapper/012:42:560
24774099317,16cyclictest310774-21ssh09:43:022
24773999310,6cyclictest0-21swapper/112:28:041
247738993122,8cyclictest329375-21sendmail-msp10:08:310
24773899310,24cyclictest343305-21fschecks_count10:22:580
24774099302,4cyclictest0-21swapper/211:34:432
247738993018,0cyclictest0-21swapper/009:52:210
24774099294,6cyclictest0-21swapper/211:45:592
247740992921,6cyclictest298406-21threads09:28:092
24773999293,6cyclictest11050irq/107-eth%d11:33:071
24773999293,4cyclictest171rcu_preempt12:31:271
24774099282,8cyclictest305612-21/usr/sbin/munin09:38:082
247739992816,6cyclictest11050irq/107-eth%d10:25:581
24773899282,2cyclictest0-21swapper/011:50:540
24773899281,1cyclictest0-21swapper/010:32:560
24773999272,7cyclictest396472-21ssh11:27:571
24773899277,16cyclictest0-21swapper/009:23:020
24773899274,2cyclictest325328-21latency_hist10:00:550
24773899271,5cyclictest380918-21/usr/sbin/munin11:08:130
24773899271,19cyclictest458457-21/usr/sbin/munin12:33:040
112699270,3rtkit-daemon1125-21rtkit-daemon07:31:041
24774099264,6cyclictest0-21swapper/209:50:412
24773999261,11cyclictest288043-21ssh09:16:171
247739992610,12cyclictest417700-21ssh11:52:001
24773899264,16cyclictest2243333-21munin-node10:59:400
24774099252,6cyclictest11050irq/107-eth%d10:15:542
247738992520,0cyclictest0-21swapper/009:48:090
24773899251,19cyclictest306263-21/usr/sbin/munin09:38:010
24773899250,3cyclictest356414-21ntp_kernel_pll_10:38:020
247740992421,2cyclictest360779-21unixbench_singl10:43:082
24774099241,4cyclictest171rcu_preempt12:18:042
24773999247,14cyclictest1005-21mta-sts-daemon10:15:561
24773999245,12cyclictest619-21mta-sts-daemon09:30:591
24773999240,8cyclictest293794-21/usr/sbin/munin09:23:021
24773899242,2cyclictest0-21swapper/010:43:020
24773899242,20cyclictest0-21swapper/011:14:500
247738992420,3cyclictest0-21swapper/009:03:030
247738992414,1cyclictest0-21swapper/009:30:540
247738992411,9cyclictest1005-21mta-sts-daemon10:45:570
24774099236,12cyclictest619-21mta-sts-daemon11:05:592
24774099234,13cyclictest378122-21sendmail-msp11:10:552
24774099233,18cyclictest111788-21systemd-journal09:52:562
24774099231,6cyclictest171rcu_preempt12:08:102
24774099230,5cyclictest0-21swapper/211:23:012
247739992311,10cyclictest310766-21ntpq09:43:021
247738992319,0cyclictest0-21swapper/012:08:080
24774099223,4cyclictest11050irq/107-eth%d11:03:062
24773999224,14cyclictest443126-21ssh12:18:021
24773999223,15cyclictest111788-21systemd-journal11:13:371
247739992213,6cyclictest430813-21sendmail-msp12:05:541
24773899223,18cyclictest311337-21grep09:43:090
247738992217,0cyclictest0-21swapper/012:38:070
247738992212,5cyclictest0-21swapper/011:38:030
24773899221,16cyclictest0-21swapper/010:13:190
24774099219,9cyclictest259-21jbd2/mmcblk0p2-812:10:552
24774099215,12cyclictest619-21mta-sts-daemon10:48:062
247740992119,1cyclictest0-21swapper/207:58:092
247740992117,3cyclictest0-21swapper/210:23:042
247740992116,4cyclictest254886-21fschecks_time07:37:592
24773899213,6cyclictest435699-21ssh12:10:550
247738992118,2cyclictest423643-21memory11:58:000
24773899211,12cyclictest0-21swapper/010:02:590
112699210,1rtkit-daemon0-21swapper/108:10:231
24774099206,7cyclictest619-21mta-sts-daemon12:01:162
24774099204,14cyclictest11050irq/107-eth%d09:55:552
247740992015,2cyclictest0-21swapper/210:33:082
247740992014,4cyclictest0-21swapper/212:22:592
24774099201,2cyclictest0-21swapper/211:41:172
24773999201,16cyclictest298051-21ntp_kernel_pll_09:28:031
24774099194,2cyclictest11050irq/107-eth%d10:38:022
24774099191,15cyclictest396720-21fschecks_time11:28:002
24773999199,7cyclictest1008-21mta-sts-daemon10:50:461
24773999196,10cyclictest111788-21systemd-journal10:09:321
24773999194,11cyclictest423806-21ntpq11:58:021
24773999192,7cyclictest0-21swapper/110:22:581
247739991914,3cyclictest0-21swapper/111:23:071
24773999191,3cyclictest11050irq/107-eth%d09:37:591
24773899196,11cyclictest11650irq/162-mmc009:07:030
247738991910,2cyclictest264128-21sed08:03:080
24774199181,8cyclictest0-21swapper/311:34:433
24774099189,5cyclictest0-21swapper/209:23:052
24774099185,8cyclictest300686-21ssh09:31:292
24774099184,11cyclictest418633-21grep11:53:002
24774099182,3cyclictest171rcu_preempt08:53:042
24774099182,12cyclictest390953-21cat11:20:542
24774099181,10cyclictest250885-21sed07:23:082
247740991810,7cyclictest762-21in:imuxsock09:20:542
24773999185,4cyclictest379702-21/usr/sbin/munin11:07:591
24773999183,11cyclictest465461-21ssh12:40:121
24773999183,10cyclictest266426-21apt-get08:10:561
24773999183,10cyclictest111788-21systemd-journal09:13:051
24773999182,10cyclictest430813-21sendmail-msp12:14:191
24773999181,3cyclictest0-21swapper/111:00:451
24773899185,9cyclictest264216-21sendmail-msp08:13:060
24773899183,11cyclictest296169-21sendmail-msp09:33:030
112699180,3rtkit-daemon1125-21rtkit-daemon10:02:501
24774099174,7cyclictest0-21swapper/212:38:022
24774099173,11cyclictest264216-21sendmail-msp08:13:022
247740991713,3cyclictest1006-21mta-sts-daemon10:59:282
24773999176,4cyclictest11050irq/107-eth%d12:42:591
24773999174,4cyclictest11050irq/107-eth%d09:03:031
24773999173,10cyclictest355677-21ssh10:37:561
24773999172,4cyclictest375805-21wc11:03:021
24773899172,11cyclictest247698-21munin-run07:15:540
112699170,3rtkit-daemon1125-21rtkit-daemon11:04:320
24774199166,6cyclictest0-21swapper/312:28:043
24774199163,7cyclictest0-21swapper/309:52:563
24774099165,7cyclictest348284-21ssh10:28:062
24774099163,8cyclictest436453-21kworker/u8:2+rpciod12:33:052
24774099162,7cyclictest329601-21ssh10:05:562
247740991614,1cyclictest1006-21mta-sts-daemon11:58:002
24773999163,8cyclictest405964-21ntpq11:38:031
24773999162,10cyclictest447422-21sh12:22:571
24773999161,9cyclictest764-21rs:main1
247739991613,2cyclictest277610-21unixbench_multi08:43:241
24773999161,10cyclictest410792-21/usr/sbin/munin11:43:081
24773999160,14cyclictest111788-21systemd-journal09:05:581
247738991613,2cyclictest279941-21fschecks_time08:52:580
112699160,3rtkit-daemon1125-21rtkit-daemon07:34:100
24774199156,5cyclictest0-21swapper/311:12:593
24774199153,7cyclictest0-21swapper/312:18:043
24774199153,6cyclictest0-21swapper/311:45:593
24774199153,6cyclictest0-21swapper/310:12:473
24774199152,8cyclictest0-21swapper/312:05:583
24774199152,6cyclictest0-21swapper/308:13:013
24774099156,7cyclictest249090-21/usr/sbin/munin07:18:072
24774099153,9cyclictest259-21jbd2/mmcblk0p2-808:46:222
24774099153,8cyclictest468450-21ssh12:43:012
247740991511,2cyclictest276675-21fschecks_time08:43:012
24774099151,11cyclictest284333-21sendmail-msp09:08:062
24774099151,11cyclictest272265-21/usr/sbin/munin08:28:062
247740991510,2cyclictest0-21swapper/208:32:582
24773999158,6cyclictest992-21lldpd09:58:061
24773999158,6cyclictest312929-21sendmail-msp09:52:561
24773999154,10cyclictest271177-21munin-run08:25:541
24773999154,10cyclictest271177-21munin-run08:25:541
24773999151,12cyclictest273389-21grep08:33:001
24773999151,12cyclictest269365-21sed08:18:121
24773999151,10cyclictest412492-21sendmail-msp11:45:561
247739991510,4cyclictest0-21swapper/109:48:071
24773999150,10cyclictest258021-21aten2.4-expect07:47:591
24773899157,6cyclictest0-21swapper/007:23:070
24773899154,8cyclictest270088-21cut08:23:000
24773899154,8cyclictest270088-21cut08:23:000
24773899154,5cyclictest287015-21ntpq09:13:040
24773899153,9cyclictest277748-21sendmail-msp08:48:010
24773899153,10cyclictest388254-21cut11:18:010
24773899153,10cyclictest271166-21sendmail-msp08:28:050
247738991512,3cyclictest282079-21ntp_kernel_pll_08:58:020
24773899150,11cyclictest428518-21ntpq12:03:030
24773899150,10cyclictest273394-21grep08:33:000
112699150,2rtkit-daemon1125-21rtkit-daemon08:05:332
24774199144,5cyclictest0-21swapper/310:05:563
24774199143,6cyclictest0-21swapper/311:25:553
24774199143,5cyclictest0-21swapper/310:15:543
24774199143,5cyclictest0-21swapper/309:31:293
24774199142,6cyclictest0-21swapper/311:05:593
24774199141,6cyclictest0-21swapper/309:55:543
24774099144,8cyclictest287148-21/usr/sbin/munin09:13:062
24774099142,8cyclictest282659-21basename09:00:532
24774099142,8cyclictest254219-21grep07:33:112
247740991411,2cyclictest0-21swapper/210:03:012
24774099141,10cyclictest260636-21wc07:53:092
24773999144,7cyclictest279995-21fschecks_time08:52:591
24773999141,9cyclictest427623-21acpi12:02:561
24773999141,9cyclictest360719-21unixbench_multi10:43:081
24773999141,9cyclictest249268-21grep07:18:071
24773999141,4cyclictest388317-21gltestperf11:18:011
247739991411,2cyclictest256527-21fschecks_time07:43:001
24773999141,10cyclictest255854-21tail07:38:101
24773999141,10cyclictest251949-21cat07:28:021
24773999141,10cyclictest251949-21cat07:28:021
24773899143,8cyclictest248510-21if_wlan007:17:580
24773899142,9cyclictest261482-21fschecks_time07:58:000
24773899142,5cyclictest277709-21sh08:45:540
24773899142,1cyclictest252215-21grep07:28:060
24773899142,1cyclictest252215-21grep07:28:060
24773899141,9cyclictest265891-21apt-config08:10:540
24773899141,8cyclictest0-21swapper/008:38:000
24773899141,11cyclictest268406-21fschecks_time08:18:020
247738991410,3cyclictest0-21swapper/007:48:000
24774199133,6cyclictest0-21swapper/312:42:563
24774199133,5cyclictest0-21swapper/309:37:563
24774199132,7cyclictest0-21swapper/311:23:013
24774199132,6cyclictest0-21swapper/312:10:553
24774199132,6cyclictest0-21swapper/311:18:063
24774199132,6cyclictest0-21swapper/310:58:013
24774199132,5cyclictest0-21swapper/310:42:223
24774199132,5cyclictest0-21swapper/309:43:023
24774099133,7cyclictest366972-21/usr/sbin/munin10:52:562
24774099133,7cyclictest0-21swapper/208:18:012
24774099132,10cyclictest408096-21latency_hist11:40:552
24774099131,3cyclictest171rcu_preempt07:28:032
24774099131,3cyclictest171rcu_preempt07:28:032
24773999134,6cyclictest281516-21/usr/sbin/munin08:57:571
24773999131,9cyclictest351604-21/usr/sbin/munin10:32:571
247739991311,2cyclictest250443-21ntp_kernel_pll_07:23:021
247739991310,2cyclictest0-21swapper/108:47:591
24773999130,1cyclictest11050irq/107-eth%d08:37:561
24773899132,7cyclictest259820-21cut07:52:590
112699130,3rtkit-daemon1006-21mta-sts-daemon07:50:552
24774199124,6cyclictest0-21swapper/311:52:583
24774199124,6cyclictest0-21swapper/310:38:003
24774199124,3cyclictest0-21swapper/308:46:223
24774199123,6cyclictest0-21swapper/308:53:043
24774199123,5cyclictest0-21swapper/310:03:053
24774199123,5cyclictest0-21swapper/309:17:573
24774199123,5cyclictest0-21swapper/308:28:023
24774199123,4cyclictest0-21swapper/312:38:023
24774199122,5cyclictest0-21swapper/310:45:553
24774199122,5cyclictest0-21swapper/310:33:033
24774199122,5cyclictest0-21swapper/307:22:553
24774199122,4cyclictest0-21swapper/311:57:593
24774199122,4cyclictest0-21swapper/308:58:023
24774199121,7cyclictest0-21swapper/312:23:063
24774099125,5cyclictest283258-21fschecks_time09:03:002
24774099123,6cyclictest0-21swapper/208:38:012
24774099121,9cyclictest256543-21fschecks_time07:43:002
24774199114,4cyclictest0-21swapper/310:27:573
24774199114,4cyclictest0-21swapper/309:23:023
24774199114,3cyclictest0-21swapper/312:33:013
24774199114,3cyclictest0-21swapper/309:45:553
24774199114,3cyclictest0-21swapper/308:43:083
24774199113,5cyclictest0-21swapper/311:03:383
24774199113,5cyclictest0-21swapper/310:23:013
24774199113,4cyclictest0-21swapper/308:18:013
24774199112,5cyclictest0-21swapper/309:07:593
24774199112,4cyclictest0-21swapper/309:27:573
24774199111,6cyclictest0-21swapper/312:02:563
24774199111,5cyclictest0-21swapper/309:13:003
24774099111,7cyclictest265295-21/usr/sbin/munin08:08:052
24773999114,5cyclictest259879-21fschecks_time07:53:001
24773999111,7cyclictest264352-21latency_hist08:05:541
24773999111,7cyclictest261493-21fschecks_time07:58:001
24773999111,6cyclictest271606-21/usr/sbin/munin08:27:581
24773899112,6cyclictest0-21swapper/007:42:580
24773899110,1cyclictest0-21swapper/007:38:010
112699110,4rtkit-daemon1007-21mta-sts-daemon07:11:072
24774199102,6cyclictest0-21swapper/310:51:473
24774199102,5cyclictest0-21swapper/308:33:003
24774199102,4cyclictest0-21swapper/311:37:583
24774199102,4cyclictest0-21swapper/307:43:013
24774199101,6cyclictest0-21swapper/308:38:073
24774199101,4cyclictest0-21swapper/307:17:543
24774199101,3cyclictest0-21swapper/308:23:103
24774199101,3cyclictest0-21swapper/308:23:103
24774099101,8cyclictest270703-21/usr/sbin/munin08:23:062
24774099101,8cyclictest270703-21/usr/sbin/munin08:23:062
2477419992,5cyclictest0-21swapper/311:42:583
2477419992,4cyclictest0-21swapper/307:28:103
2477419992,4cyclictest0-21swapper/307:28:103
2477419992,3cyclictest0-21swapper/308:02:553
2477419991,5cyclictest0-21swapper/308:08:053
2477419991,5cyclictest0-21swapper/307:37:563
2477419991,4cyclictest0-21swapper/307:58:063
2477419991,4cyclictest0-21swapper/307:47:593
2477399991,7cyclictest247773-21latency_hist07:15:541
2477419982,4cyclictest0-21swapper/307:53:033
2477419982,4cyclictest0-21swapper/307:33:093
2477419981,5cyclictest0-21swapper/309:02:583
2477419941,2cyclictest0-21swapper/307:15:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional