You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 11:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Fri Dec 12, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
411519799452,35cyclictest0-21swapper/000:01:300
4115197994324,6cyclictest52167-21ssh22:58:200
4115197993714,15cyclictest11050irq/107-eth%d22:51:200
4115199993626,7cyclictest22885-21sendmail-msp22:33:112
411519799346,25cyclictest111788-21systemd-journal21:49:240
4115197993420,4cyclictest62956-21ssh23:11:160
411519799336,4cyclictest4118485-21systemctl19:26:150
411519799332,9cyclictest565-21ssh22:00:280
4115199993223,6cyclictest0-21swapper/222:08:262
411519899314,6cyclictest0-21swapper/121:50:291
4115197993118,12cyclictest151ktimers/020:53:170
411519999306,18cyclictest4192885-21ntp_states21:58:192
411519899309,8cyclictest11050irq/107-eth%d21:53:101
411519799282,26cyclictest0-21swapper/022:11:160
411519799281,22cyclictest125608-21apt-get00:21:170
411519999276,7cyclictest171rcu_preempt22:38:142
4115199992712,14cyclictest1006-21mta-sts-daemon21:36:202
411519899275,7cyclictest127423-21ssh00:23:151
411519899273,16cyclictest111788-21systemd-journal21:36:201
4115198992717,9cyclictest764-21rs:main1
411519799272,23cyclictest41971-21fschecks_count22:48:080
4115199992613,4cyclictest171rcu_preempt22:28:152
411519799262,4cyclictest4173718-21ssh21:36:530
411519799262,18cyclictest140647-21unixbench_multi00:38:250
411519799262,18cyclictest140647-21unixbench_multi00:38:250
411519799261,21cyclictest0-21swapper/023:58:180
4115198992521,3cyclictest133891-21gpgv00:31:161
4115198992520,4cyclictest112004-21date00:06:161
411519799255,14cyclictest78367-21/usr/sbin/munin23:28:190
411519799253,17cyclictest0-21swapper/023:23:170
4115197992515,6cyclictest0-21swapper/000:28:000
411519999243,2cyclictest65055-21ssh23:13:172
4115199992410,11cyclictest111788-21systemd-journal00:06:162
4115198992413,7cyclictest0-21swapper/119:16:161
411519799246,14cyclictest16419-21ntp_states22:18:180
411519799246,14cyclictest120568-21apt-get00:16:200
411519799242,4cyclictest114193-21ssh00:08:160
4115197992421,1cyclictest0-21swapper/022:29:090
4115197992416,3cyclictest4166174-21needreboot21:28:250
4115199992314,5cyclictest351ktimers/220:13:182
411519899232,14cyclictest2243333-21munin-node20:33:171
4115198992313,5cyclictest0-21swapper/100:31:171
411519799238,4cyclictest171rcu_preempt23:03:200
4115197992317,0cyclictest0-21swapper/023:16:160
4115197992313,6cyclictest151ktimers/020:26:150
4115197992312,7cyclictest151ktimers/021:55:520
4115197992311,9cyclictest4170887-21sh21:33:230
411519999224,11cyclictest129434-21sendmail-msp00:28:002
4115199992214,8cyclictest59064-21kworker/u8:0+events_unbound23:38:142
411519899225,11cyclictest106001-21ssh23:58:491
411519899224,15cyclictest4192889-21ntpq21:58:191
411519899223,11cyclictest87140-21ntpq23:38:141
411519899222,12cyclictest4170604-21ssh21:33:151
411519899221,13cyclictest47400-21ssh22:53:181
411519799226,8cyclictest4115160-21munin-run19:16:150
4115197992210,5cyclictest33189-21/usr/sbin/munin22:38:090
411519999215,2cyclictest0-21swapper/200:01:302
411519999214,3cyclictest171rcu_preempt00:13:202
4115199992111,1cyclictest171rcu_preempt00:39:542
4115199992111,1cyclictest171rcu_preempt00:39:542
411519799217,4cyclictest28479-21munin-node22:33:100
411519799214,2cyclictest171rcu_preempt23:48:170
4115197992118,2cyclictest135521-21cut00:33:140
4115197992116,4cyclictest762-21in:imuxsock23:33:160
411519799211,4cyclictest11050irq/107-eth%d21:26:160
411519799210,4cyclictest91628-21ntpq23:43:140
411519799210,3cyclictest171rcu_preempt19:28:150
411519999209,8cyclictest11050irq/107-eth%d00:33:272
411519999203,15cyclictest619-21mta-sts-daemon00:21:182
411519899204,11cyclictest111788-21systemd-journal23:13:171
411519799207,2cyclictest171rcu_preempt20:31:390
411519799206,13cyclictest151ktimers/019:48:080
411519799203,2cyclictest5516-21sendmail-msp22:06:160
411519999191,6cyclictest0-21swapper/221:28:192
411519999191,14cyclictest11050irq/107-eth%d22:51:202
411519899199,8cyclictest10075-21ssh22:11:161
411519899195,11cyclictest0-21swapper/120:13:171
411519899192,10cyclictest111788-21systemd-journal21:28:251
4115198991915,2cyclictest4122641-21cut19:38:081
411519799193,14cyclictest4134221-21fschecks_time20:13:100
411519799192,8cyclictest37164-21/usr/sbin/munin22:43:160
112699190,7rtkit-daemon1005-21mta-sts-daemon22:23:140
112699190,3rtkit-daemon1006-21mta-sts-daemon20:09:231
411519999183,10cyclictest4149630-21/usr/sbin/munin20:58:162
411519999182,4cyclictest171rcu_preempt21:43:222
411519999182,4cyclictest171rcu_preempt21:43:222
411519999182,14cyclictest351ktimers/219:16:152
4115199991813,4cyclictest0-21swapper/200:18:242
4115199991810,6cyclictest111788-21systemd-journal20:08:212
4115199991810,4cyclictest0-21swapper/221:55:522
411519899185,9cyclictest69411-21awk23:18:131
411519899185,8cyclictest120568-21apt-get00:16:191
411519899185,2cyclictest0-21swapper/123:48:071
411519899184,7cyclictest91802-21/usr/sbin/munin23:43:161
411519899184,11cyclictest111953-21sendmail-msp00:13:201
411519899183,12cyclictest5516-21sendmail-msp22:06:231
411519899181,8cyclictest11050irq/107-eth%d22:48:081
4115198991812,4cyclictest141907-21idleruntime-cro00:41:151
4115198991812,4cyclictest141907-21idleruntime-cro00:41:151
411519899181,13cyclictest15764-21grep22:18:111
4115198991810,5cyclictest1007-21mta-sts-daemon19:31:201
411519799183,14cyclictest0-21swapper/023:53:210
4115197991811,5cyclictest151ktimers/020:08:150
4115197991810,2cyclictest171rcu_preempt19:53:110
411519799180,11cyclictest6754-21/usr/sbin/munin22:08:160
411519999176,8cyclictest91465-21wc23:43:122
411519999175,10cyclictest4181914-21sendmail-msp21:46:162
411519899173,12cyclictest4142480-21grep20:38:121
411519799179,7cyclictest0-21swapper/021:13:180
411519799176,5cyclictest171rcu_preempt19:33:110
411519799173,0cyclictest0-21swapper/000:43:230
411520099164,5cyclictest0-21swapper/322:11:163
411520099162,7cyclictest0-21swapper/320:13:173
411519999169,5cyclictest4132057-1kworker/2:2H-kblockd21:33:152
411519999164,7cyclictest619-21mta-sts-daemon19:53:212
411519999163,9cyclictest111788-21systemd-journal23:53:182
411519999162,3cyclictest11050irq/107-eth%d23:58:122
411519999161,5cyclictest2641-21df_inode22:03:092
4115199991613,2cyclictest40361-21sendmail-msp22:46:152
411519899165,8cyclictest111788-21systemd-journal23:06:161
411519899164,7cyclictest764-21rs:main1
411519899161,11cyclictest22885-21sendmail-msp22:28:161
411519799162,8cyclictest4139227-21/usr/sbin/munin20:28:140
411519799161,12cyclictest4135890-21cut20:18:090
411519799160,16cyclictest0-21swapper/021:42:000
411519799160,16cyclictest0-21swapper/021:42:000
112699160,1rtkit-daemon1007-21mta-sts-daemon19:30:082
411520099158,5cyclictest0-21swapper/321:36:203
411520099154,6cyclictest0-21swapper/322:03:153
411520099152,7cyclictest0-21swapper/322:38:143
411520099152,7cyclictest0-21swapper/321:08:243
411519999159,5cyclictest0-21swapper/219:48:142
411519999155,5cyclictest143677-21ssh00:43:192
411519999152,8cyclictest69442-21ssh23:18:132
411519999152,8cyclictest1005-21mta-sts-daemon22:48:142
411519999152,2cyclictest171rcu_preempt23:08:162
4115199991512,2cyclictest4116828-21sh19:21:152
4115199991512,2cyclictest0-21swapper/222:13:152
4115199991511,3cyclictest4129271-21fschecks_time19:58:092
411519999151,12cyclictest78122-21/usr/sbin/munin23:28:162
411519899156,8cyclictest607-21dbus-daemon20:01:151
411519899156,5cyclictest51923-21ssh22:58:161
411519899152,3cyclictest0-21swapper/121:26:161
411519899152,10cyclictest4138618-21sendmail-msp20:28:171
4115198991513,1cyclictest1007-21mta-sts-daemon23:30:181
411519899151,2cyclictest0-21swapper/121:21:151
4115198991511,3cyclictest40374-21munin-run22:46:151
4115198991511,2cyclictest60293-21gltestperf23:08:121
411519799157,6cyclictest191rcuc/021:18:100
411519799151,6cyclictest171rcu_preempt21:08:230
4115197991512,2cyclictest4131933-21unixbench_singl20:03:180
411519799151,13cyclictest0-21swapper/023:39:150
411520099145,6cyclictest0-21swapper/323:53:083
411520099143,6cyclictest0-21swapper/322:18:183
411520099143,5cyclictest0-21swapper/321:28:263
411520099142,5cyclictest0-21swapper/320:48:203
411520099141,6cyclictest0-21swapper/323:13:173
411519999146,5cyclictest0-21swapper/223:03:162
411519999144,5cyclictest4153924-21/usr/sbin/munin21:13:092
411519999143,6cyclictest4161156-21/usr/sbin/munin21:23:122
411519999142,9cyclictest51152-21/usr/sbin/munin22:58:102
411519999142,9cyclictest4137536-21grep20:23:102
411519999142,8cyclictest4138618-21sendmail-msp20:28:182
411519999142,3cyclictest171rcu_preempt19:26:152
411519999142,1cyclictest171rcu_preempt19:32:252
4115199991411,2cyclictest76246-21sendmail-msp23:35:292
411519999141,11cyclictest4152420-21grep21:08:182
411519999141,11cyclictest4130576-21/usr/sbin/munin20:03:062
411519899149,3cyclictest0-21swapper/119:28:201
411519899148,3cyclictest0-21swapper/123:23:091
411519899143,8cyclictest76246-21sendmail-msp23:33:171
411519899143,8cyclictest4125445-21true19:46:151
411519899142,9cyclictest4180219-21unixbench_singl21:43:221
411519899142,9cyclictest4180219-21unixbench_singl21:43:221
411519899142,6cyclictest143610-21awk00:43:171
411519899142,10cyclictest992-21lldpd21:03:161
411519899141,9cyclictest4155063-21diskmemload22:38:141
411519899141,8cyclictest22989-21latency_hist22:26:161
411519899141,7cyclictest4151782-21sendmail-msp21:09:511
4115198991411,2cyclictest4145075-21unixbench_multi20:43:191
4115198991410,3cyclictest0-21swapper/119:18:161
411519899140,13cyclictest2371-21basename22:03:071
411519799148,2cyclictest762-21in:imuxsock00:12:260
411519799147,2cyclictest4128935-21/usr/sbin/munin19:58:120
411519799146,7cyclictest0-21swapper/020:48:210
411519799145,6cyclictest4125412-21idleruntime-cro19:46:150
411519799141,9cyclictest0-21swapper/023:18:110
4115197991411,2cyclictest4151694-21unixbench_singl21:03:220
4115197991411,0cyclictest0-21swapper/019:18:070
112699140,0rtkit-daemon0-21swapper/020:42:330
411520099135,4cyclictest0-21swapper/300:33:213
411520099135,3cyclictest0-21swapper/322:28:163
411520099134,3cyclictest0-21swapper/322:51:163
411520099133,6cyclictest0-21swapper/300:03:083
411520099133,5cyclictest0-21swapper/320:46:153
411520099133,4cyclictest0-21swapper/322:58:163
411520099132,6cyclictest0-21swapper/323:08:163
411520099132,6cyclictest0-21swapper/322:23:103
411520099132,6cyclictest0-21swapper/320:33:173
411520099132,5cyclictest0-21swapper/323:33:073
411520099132,5cyclictest0-21swapper/321:51:333
411520099132,4cyclictest0-21swapper/323:43:163
411520099131,6cyclictest0-21swapper/300:13:203
411519999135,6cyclictest4122643-21fschecks_count19:38:082
411519999133,8cyclictest4147219-21/usr/sbin/munin20:53:102
411519999133,8cyclictest4138618-21sendmail-msp20:32:072
411519999132,6cyclictest96179-21ssh23:48:182
411519999132,10cyclictest4145779-21fschecks_time20:48:122
411519999131,10cyclictest4151674-21grep21:03:222
411519999131,10cyclictest4124388-21fschecks_time19:43:102
411519999131,10cyclictest23056-21latency_hist22:26:162
411519899133,5cyclictest4136333-21/usr/sbin/munin20:18:121
411519899132,8cyclictest4125440-21sendmail-msp19:53:151
411519899132,8cyclictest111788-21systemd-journal20:26:151
411519899131,10cyclictest4154115-21head21:13:111
411519799137,4cyclictest0-21swapper/019:38:090
411519799130,10cyclictest4149029-21fschecks_time20:58:090
411520099123,6cyclictest0-21swapper/321:23:193
411520099123,6cyclictest0-21swapper/300:31:163
411520099123,5cyclictest0-21swapper/321:58:193
411520099122,6cyclictest0-21swapper/322:33:193
411520099122,5cyclictest0-21swapper/321:06:153
411520099122,5cyclictest0-21swapper/319:48:143
411520099122,5cyclictest0-21swapper/319:23:143
411520099121,9cyclictest0-21swapper/300:06:163
411520099121,7cyclictest0-21swapper/322:48:103
411520099121,6cyclictest0-21swapper/320:03:133
411520099121,6cyclictest0-21swapper/300:16:213
411519999125,5cyclictest4144093-21cut20:43:082
411519999124,5cyclictest0-21swapper/222:18:162
411519999123,7cyclictest4142485-21fschecks_time20:38:132
411519999123,5cyclictest73053-21/usr/sbin/munin23:23:092
411519999122,8cyclictest4156465-21/usr/sbin/munin21:18:092
411519899124,4cyclictest4147061-21/usr/sbin/munin20:53:081
411519899122,8cyclictest4145778-21tune2fs20:48:121
411519899121,9cyclictest4117338-21fschecks_count19:23:111
411519899121,6cyclictest28572-21aten_r2power_fr22:33:111
4115198991210,1cyclictest0-21swapper/120:03:101
411519899120,11cyclictest4126459-21awk19:48:141
411519799120,1cyclictest4142503-21tune2fs20:38:130
411520099114,4cyclictest0-21swapper/323:58:153
411520099113,4cyclictest0-21swapper/321:46:163
411520099113,4cyclictest0-21swapper/321:18:143
411520099113,3cyclictest0-21swapper/323:28:123
411520099112,6cyclictest0-21swapper/322:41:273
411520099112,5cyclictest0-21swapper/319:43:103
411520099112,5cyclictest0-21swapper/319:31:193
411520099112,5cyclictest0-21swapper/300:21:183
411520099112,4cyclictest0-21swapper/321:46:163
411520099112,4cyclictest0-21swapper/321:13:163
411520099111,6cyclictest0-21swapper/300:38:193
411520099111,6cyclictest0-21swapper/300:38:193
411520099111,5cyclictest0-21swapper/323:02:383
411520099111,4cyclictest0-21swapper/323:23:243
411519999111,6cyclictest4136049-21/usr/sbin/munin20:18:092
411520099106,2cyclictest0-21swapper/320:28:213
411520099103,5cyclictest0-21swapper/322:08:263
411520099103,4cyclictest0-21swapper/323:17:053
411520099103,4cyclictest0-21swapper/319:53:143
411520099103,4cyclictest0-21swapper/300:43:163
411520099102,5cyclictest0-21swapper/321:33:103
411520099102,4cyclictest0-21swapper/323:46:443
411520099102,4cyclictest0-21swapper/320:23:113
411520099102,3cyclictest0-21swapper/319:16:163
411520099101,5cyclictest0-21swapper/323:37:213
411519899101,7cyclictest4148834-21aten2.4-expect20:58:081
41152009993,5cyclictest0-21swapper/320:38:123
41152009993,4cyclictest0-21swapper/319:26:283
41152009992,3cyclictest0-21swapper/320:53:103
41152009992,3cyclictest0-21swapper/320:08:083
41152009990,4cyclictest0-21swapper/321:42:253
41152009984,3cyclictest0-21swapper/319:38:123
41152009983,4cyclictest0-21swapper/319:18:103
41152009982,4cyclictest0-21swapper/320:58:133
41152009982,3cyclictest0-21swapper/320:18:063
41152009981,4cyclictest0-21swapper/319:58:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional