You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 21:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Thu Nov 27, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55060799433,10cyclictest680344-21ntpq11:08:091
55060699353,31cyclictest0-21swapper/012:41:530
55060699352,30cyclictest0-21swapper/009:26:110
55060699352,22cyclictest646652-21cat10:26:030
55060699352,22cyclictest646652-21cat10:26:030
55060799348,11cyclictest746662-21sendmail-msp12:27:591
550606993410,2cyclictest0-21swapper/010:53:090
55060699333,12cyclictest555770-21/usr/sbin/munin07:33:080
55060899312,7cyclictest11050irq/107-eth%d12:31:512
55060899312,7cyclictest11050irq/107-eth%d12:31:512
550608993119,8cyclictest587194-21sendmail-msp09:06:212
55060699301,27cyclictest607990-21fschecks_count09:37:590
550606993010,15cyclictest602279-21apt-get09:31:070
55060699300,3cyclictest0-21swapper/012:32:020
55060699300,3cyclictest0-21swapper/012:32:020
55060899291,25cyclictest583276-21/usr/sbin/munin08:53:132
550607992918,8cyclictest646551-21sendmail-msp10:26:081
550608992812,12cyclictest111788-21systemd-journal12:28:382
550607992814,11cyclictest111788-21systemd-journal12:34:121
550607992814,11cyclictest111788-21systemd-journal12:34:121
55060699289,14cyclictest111788-21systemd-journal09:06:210
55060699283,23cyclictest0-21swapper/010:32:030
55060899275,17cyclictest992-21lldpd10:41:062
55060799271,3cyclictest171rcu_preempt11:58:121
55060899263,17cyclictest744056-21ntpq12:23:062
550607992619,6cyclictest700068-21fschecks_count11:33:021
55060799261,4cyclictest171rcu_preempt12:16:031
550607992612,8cyclictest764-21rs:main1
55060699263,17cyclictest595493-21/usr/sbin/munin09:23:040
550606992616,6cyclictest0-21swapper/009:18:030
55060699260,5cyclictest739164-21find12:18:090
55060699260,14cyclictest0-21swapper/010:08:020
55060899257,13cyclictest619-21mta-sts-daemon10:33:512
55060699253,20cyclictest558811-21latency_hist07:41:030
55060699250,5cyclictest720794-21awk11:58:060
55060699250,3cyclictest625338-21switchtime09:58:140
55060899244,15cyclictest647147-21ssh10:26:072
550608992416,6cyclictest604204-21idleruntime09:33:082
550608992414,4cyclictest11050irq/107-eth%d12:03:032
550608992414,4cyclictest11050irq/107-eth%d12:03:032
55060799246,13cyclictest111788-21systemd-journal09:46:071
55060799243,6cyclictest171rcu_preempt11:53:081
550607992416,5cyclictest261rcuc/112:11:351
55060799240,15cyclictest0-21swapper/110:54:511
55060699241,23cyclictest615480-21ssh09:46:060
112699240,5rtkit-daemon1125-21rtkit-daemon09:43:022
55060899233,16cyclictest692570-21ntp_states11:23:092
55060799231,5cyclictest171rcu_preempt09:31:131
55060699232,18cyclictest716810-21ntpq11:53:080
55060699232,15cyclictest111788-21systemd-journal10:46:070
550606992317,4cyclictest607-21dbus-daemon08:41:020
55060699230,17cyclictest675976-21fschecks_time11:03:020
55060799222,4cyclictest171rcu_preempt10:33:521
55060799221,8cyclictest629242-21ssh10:03:091
550607992218,3cyclictest695979-21fschecks_count11:28:051
55060699228,4cyclictest171rcu_preempt07:16:020
550606992218,3cyclictest646551-21sendmail-msp10:29:160
550606992216,4cyclictest589427-21fschecks_time09:13:040
550606992216,4cyclictest589427-21fschecks_time09:13:040
55060899213,13cyclictest550605-21systemd-run07:16:022
550608992114,6cyclictest560487-21sendmail-msp07:48:042
55060899211,1cyclictest69-21kswapd009:46:062
55060899210,16cyclictest734214-21ntpq12:13:082
55060799215,12cyclictest758939-21ssh12:38:021
55060799213,3cyclictest171rcu_preempt10:13:111
55060799212,3cyclictest171rcu_preempt10:43:031
55060799212,16cyclictest111788-21systemd-journal08:53:131
55060699219,3cyclictest0-21swapper/012:08:000
55060699215,1cyclictest743116-21ssh12:22:580
55060699214,16cyclictest680341-21ssh11:08:090
55060699211,18cyclictest749096-21ntpq12:28:060
55060699211,18cyclictest0-21swapper/011:48:070
112699210,2rtkit-daemon0-21swapper/210:17:472
55060899207,10cyclictest615711-1kworker/2:1H+kblockd10:46:072
55060899205,9cyclictest721327-21/usr/sbin/munin11:58:122
55060899202,10cyclictest11050irq/107-eth%d11:43:062
55060799202,15cyclictest624988-21ntpq09:58:091
550607992017,2cyclictest0-21swapper/112:23:051
55060699204,10cyclictest694461-21apt11:26:030
550606992010,8cyclictest696510-21ntpq11:28:110
55060899194,10cyclictest556629-21/usr/sbin/munin07:33:082
55060899193,11cyclictest684324-21ssh11:13:072
55060799197,9cyclictest1007-21mta-sts-daemon07:35:161
55060799196,7cyclictest550605-21systemd-run07:16:021
55060799194,10cyclictest727740-21ssh12:06:171
55060799193,11cyclictest602408-21cat09:31:031
55060799192,2cyclictest11050irq/107-eth%d11:13:071
55060699193,14cyclictest708309-21grep11:43:020
55060699192,4cyclictest660038-21/usr/sbin/munin10:43:030
550606991914,4cyclictest0-21swapper/011:38:070
550606991911,5cyclictest636997-21/usr/sbin/munin10:13:140
55060999183,8cyclictest0-21swapper/309:33:453
55060899188,6cyclictest592489-21ntpq09:18:072
55060899183,8cyclictest629082-21ssh10:03:062
550608991814,3cyclictest625529-21unixbench_multi09:58:152
55060899181,15cyclictest700609-21ntpq11:33:072
55060799189,6cyclictest710966-21sendmail-msp11:47:411
55060799183,8cyclictest587194-21sendmail-msp09:11:031
55060799183,8cyclictest587194-21sendmail-msp09:11:031
55060799183,5cyclictest171rcu_preempt09:11:031
55060799183,12cyclictest673038-21ssh10:58:081
55060699187,4cyclictest612989-21/usr/sbin/munin09:43:100
55060699184,11cyclictest581883-21apt-get08:51:090
55060699182,13cyclictest573640-21munin-run08:26:020
55060699181,6cyclictest684410-21ssh11:13:080
550606991813,3cyclictest758751-21fschecks_time12:38:010
550606991813,1cyclictest0-21swapper/011:18:060
55060899179,4cyclictest0-21swapper/208:22:582
55060899173,8cyclictest644055-21tune2fs10:23:032
55060899173,8cyclictest644055-21tune2fs10:23:032
55060899172,12cyclictest710966-21sendmail-msp11:46:442
55060799175,3cyclictest171rcu_preempt10:23:061
55060799175,3cyclictest171rcu_preempt10:23:061
55060799175,10cyclictest111788-21systemd-journal10:46:571
55060799172,2cyclictest171rcu_preempt09:55:171
55060799172,2cyclictest171rcu_preempt09:55:171
55060799171,5cyclictest596356-21ntpq09:23:061
55060799171,5cyclictest0-21swapper/108:38:021
550607991714,2cyclictest562108-21cron07:51:021
55060699177,1cyclictest734157-21uname12:13:070
55060699176,3cyclictest614905-21sendmail-msp09:53:080
55060699176,3cyclictest614905-21sendmail-msp09:53:080
55060699174,11cyclictest567077-21sendmail-msp08:06:270
55060699173,9cyclictest672247-21head10:58:010
55060699173,1cyclictest700065-21grep11:33:020
550606991713,1cyclictest0-21swapper/010:38:050
55060699170,2cyclictest724396-21grep12:03:000
55060699170,2cyclictest724396-21grep12:03:000
55060999165,5cyclictest0-21swapper/312:13:083
55060999162,10cyclictest0-21swapper/310:53:083
55060899169,6cyclictest621054-21fschecks_time09:53:042
55060899169,6cyclictest621054-21fschecks_time09:53:042
55060899167,5cyclictest696512-21ssh11:28:112
55060899167,4cyclictest668665-21/usr/sbin/munin10:53:082
55060899164,9cyclictest567549-21/usr/sbin/munin08:08:002
55060899163,8cyclictest705897-21ssh11:39:212
55060899163,6cyclictest631109-21sendmail-msp10:13:112
55060899162,7cyclictest607823-21aten_r2power_vo09:37:582
55060899161,10cyclictest761994-21latency_hist12:41:032
55060899161,10cyclictest658876-21awk10:41:032
55060799166,7cyclictest727178-21ssh12:05:451
55060799166,7cyclictest727178-21ssh12:05:451
55060799165,9cyclictest1006-21mta-sts-daemon11:02:581
55060799164,7cyclictest764657-21ssh12:43:111
55060799164,10cyclictest573648-21awk08:26:021
550607991614,1cyclictest0-21swapper/110:38:121
550607991611,3cyclictest705242-21unixbench_singl11:38:121
55060799161,12cyclictest560377-21sed07:43:141
55060699165,2cyclictest567086-21unin-run08:06:030
55060699161,12cyclictest567077-21sendmail-msp08:13:400
55060699160,16cyclictest0-21swapper/010:02:270
112699160,2rtkit-daemon1125-21rtkit-daemon09:21:292
112699160,2rtkit-daemon1125-21rtkit-daemon08:50:011
55060999152,8cyclictest0-21swapper/307:33:073
55060999152,7cyclictest0-21swapper/310:33:523
55060999152,6cyclictest0-21swapper/311:48:363
55060999152,5cyclictest0-21swapper/310:26:073
55060999151,5cyclictest0-21swapper/310:03:063
55060899153,8cyclictest111788-21systemd-journal09:28:002
55060899152,9cyclictest763989-21ssh12:43:032
55060899151,10cyclictest586052-21fschecks_count09:03:002
55060799158,5cyclictest0-21swapper/107:58:151
55060799155,8cyclictest554203-21aten_r2power_en07:28:011
55060799155,7cyclictest631109-21sendmail-msp10:06:031
55060799153,9cyclictest111788-21systemd-journal07:56:031
55060799153,9cyclictest111788-21systemd-journal07:56:031
55060799153,4cyclictest591781-21aten_r2power_vo09:18:011
550607991512,2cyclictest0-21swapper/109:38:001
550607991511,3cyclictest570915-21cut08:18:021
55060799151,10cyclictest612278-21fschecks_time09:43:021
55060699152,9cyclictest641527-21/usr/sbin/munin10:18:140
550606991510,4cyclictest0-21swapper/008:33:080
55060699150,10cyclictest580257-21sendmail-msp08:48:050
112699150,2rtkit-daemon1125-21rtkit-daemon08:43:302
55060999145,6cyclictest0-21swapper/309:48:083
55060999144,6cyclictest0-21swapper/311:13:073
55060999144,6cyclictest0-21swapper/309:11:033
55060999142,7cyclictest0-21swapper/311:33:073
55060999141,6cyclictest0-21swapper/309:26:433
55060899145,6cyclictest570271-21/usr/sbin/munin08:13:132
55060899142,9cyclictest715817-21ssh11:52:412
55060899142,7cyclictest58-21kcompactd012:16:032
55060899141,9cyclictest584440-21fschecks_time08:58:022
55060899141,11cyclictest563948-21cat07:56:032
55060899141,11cyclictest563948-21cat07:56:032
55060799148,4cyclictest0-21swapper/107:38:001
55060799145,6cyclictest764-21rs:main1
55060799144,8cyclictest691046-21ssh11:21:541
55060799143,8cyclictest640467-21grep10:18:041
550607991410,3cyclictest575236-21grep08:28:121
55060799140,9cyclictest575562-21aten_r2power_cu08:32:591
55060799140,8cyclictest586033-21fschecks_count09:03:001
55060799140,10cyclictest584460-21cut08:58:021
55060699149,2cyclictest11650irq/162-mmc008:28:110
55060699141,7cyclictest560354-21grep07:43:140
112699140,2rtkit-daemon573673-21sendmail-msp08:26:042
112699140,2rtkit-daemon1125-21rtkit-daemon07:37:232
55060999135,4cyclictest0-21swapper/312:28:063
55060999135,3cyclictest0-21swapper/308:28:113
55060999134,4cyclictest0-21swapper/311:51:043
55060999133,8cyclictest0-21swapper/309:53:023
55060999133,8cyclictest0-21swapper/309:53:023
55060999133,6cyclictest0-21swapper/309:38:043
55060999133,6cyclictest0-21swapper/308:53:043
55060999133,5cyclictest0-21swapper/309:58:093
55060999132,6cyclictest0-21swapper/310:46:063
55060999132,5cyclictest0-21swapper/308:08:133
55060999131,7cyclictest0-21swapper/312:03:033
55060999131,7cyclictest0-21swapper/312:03:033
55060999131,6cyclictest0-21swapper/312:38:063
55060999131,6cyclictest0-21swapper/310:13:073
55060899138,3cyclictest552252-21unin-run07:21:032
55060899134,6cyclictest729597-21/usr/sbin/munin12:08:062
55060899133,6cyclictest566170-21/usr/sbin/munin08:03:002
55060899132,8cyclictest672072-21/usr/sbin/munin10:57:592
55060899132,8cyclictest577443-21/usr/sbin/munin08:38:002
55060899131,9cyclictest679590-21/usr/sbin/munin11:08:012
55060899131,9cyclictest553874-21munin-run07:26:022
55060899131,8cyclictest675705-21/usr/sbin/munin11:03:002
55060899131,7cyclictest687828-21cut11:18:022
55060899131,10cyclictest633510-21timerandwakeup10:08:152
55060799133,7cyclictest707977-21/usr/sbin/munin11:43:041
55060799132,8cyclictest0-21swapper/108:43:111
55060799131,10cyclictest552900-21grep07:23:021
55060699139,2cyclictest0-21swapper/007:28:010
55060699133,8cyclictest561071-21fschecks_time07:48:020
55060699133,6cyclictest580225-21munin-run08:46:030
55060699132,9cyclictest111788-21systemd-journal07:26:020
55060699132,6cyclictest570577-21/usr/sbin/munin08:18:020
55060699131,9cyclictest562622-21/usr/sbin/munin07:53:040
55060699131,9cyclictest562622-21/usr/sbin/munin07:53:040
550606991311,1cyclictest0-21swapper/009:03:000
55060999124,5cyclictest0-21swapper/310:43:063
55060999124,3cyclictest0-21swapper/307:28:103
55060999123,7cyclictest0-21swapper/312:31:193
55060999123,7cyclictest0-21swapper/312:31:193
55060999123,5cyclictest0-21swapper/312:23:063
55060999123,4cyclictest0-21swapper/311:58:123
55060999123,4cyclictest0-21swapper/311:03:033
55060999122,5cyclictest0-21swapper/312:43:073
55060999122,5cyclictest0-21swapper/308:38:043
55060999121,7cyclictest0-21swapper/310:58:083
55060999121,6cyclictest0-21swapper/307:43:073
55060899129,2cyclictest565318-21grep07:58:192
55060899124,6cyclictest571511-21/usr/sbin/munin08:18:072
55060899124,6cyclictest559626-21/usr/sbin/munin07:43:052
55060899124,4cyclictest589970-21/usr/sbin/munin09:13:102
55060899124,4cyclictest589970-21/usr/sbin/munin09:13:102
55060899122,6cyclictest580862-21tune2fs08:48:082
55060899121,9cyclictest554202-21aten_r2power_en07:28:012
55060899121,8cyclictest573673-21sendmail-msp08:33:092
55060799127,4cyclictest967-21snmpd11:18:011
55060799122,7cyclictest550966-21/usr/sbin/munin07:18:011
55060699125,5cyclictest0-21swapper/007:18:000
55060699122,8cyclictest584107-21/usr/sbin/munin08:57:590
55060999114,4cyclictest0-21swapper/310:06:033
55060999113,6cyclictest0-21swapper/308:13:083
55060999113,4cyclictest0-21swapper/308:33:093
55060999113,3cyclictest0-21swapper/311:08:033
55060999112,6cyclictest0-21swapper/312:08:093
55060999112,5cyclictest0-21swapper/311:43:063
55060999112,4cyclictest0-21swapper/307:38:003
55060999111,6cyclictest0-21swapper/310:37:593
55060999111,6cyclictest0-21swapper/310:23:013
55060999111,6cyclictest0-21swapper/310:23:013
55060999111,5cyclictest0-21swapper/311:23:043
55060999111,5cyclictest0-21swapper/308:48:103
55060999110,6cyclictest0-21swapper/307:53:063
55060999110,6cyclictest0-21swapper/307:53:063
55060699113,6cyclictest564281-21fschecks_count07:58:090
55060999104,3cyclictest0-21swapper/309:43:033
55060999104,3cyclictest0-21swapper/308:03:053
55060999103,5cyclictest0-21swapper/311:28:073
55060999103,4cyclictest0-21swapper/309:11:033
55060999103,4cyclictest0-21swapper/309:11:033
55060999103,4cyclictest0-21swapper/307:18:113
55060999102,6cyclictest0-21swapper/312:18:123
55060999102,4cyclictest0-21swapper/308:42:593
55060999102,4cyclictest0-21swapper/308:18:033
55060999102,3cyclictest0-21swapper/309:02:583
55060999102,3cyclictest0-21swapper/307:23:013
55060999101,5cyclictest0-21swapper/308:23:063
55060999101,5cyclictest0-21swapper/307:58:143
55060999100,5cyclictest0-21swapper/311:18:043
55060799102,5cyclictest566048-21grep08:03:001
5506099994,2cyclictest0-21swapper/308:58:063
5506099993,4cyclictest0-21swapper/309:23:073
5506099992,4cyclictest0-21swapper/310:18:053
5506099983,4cyclictest0-21swapper/311:38:013
5506099982,5cyclictest0-21swapper/309:18:123
5506099982,3cyclictest0-21swapper/307:47:593
5506099942,2cyclictest0-21swapper/307:16:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional