You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-10 - 23:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7.osadl.org (updated Wed Dec 10, 2025 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
308127099551,31cyclictest0-21swapper/012:31:210
3081272995448,3cyclictest3113758-21latency_hist08:51:141
3081272995448,3cyclictest3113758-21latency_hist08:51:141
308127099504,11cyclictest3081268-21cyclictest07:16:140
308127099492,46cyclictest3203217-21/usr/sbin/munin11:08:150
308127099482,6cyclictest3166891-21latency_hist10:16:150
3081270994433,10cyclictest3217129-21sendmail-msp11:28:390
3081270994325,3cyclictest0-21swapper/009:28:020
3081270994218,5cyclictest0-21swapper/011:50:260
3081270994128,9cyclictest3084574-21sendmail-msp07:36:000
3081272993915,16cyclictest3081268-21cyclictest11:49:541
308127099361,34cyclictest0-21swapper/008:53:230
308127099360,34cyclictest0-21swapper/010:55:530
308127399352,18cyclictest3131824-1kworker/2:0H+kblockd09:46:182
3081270993525,1cyclictest0-21swapper/010:08:200
3081273993429,3cyclictest1007-21mta-sts-daemon08:33:262
308127399342,7cyclictest3154330-21ntpq09:58:152
308127399342,7cyclictest3154330-21ntpq09:58:152
308127399342,24cyclictest3105043-21sendmail-msp08:27:152
308127099344,1cyclictest3144764-21ssh09:46:180
3081270993420,3cyclictest0-21swapper/009:13:160
3081270993410,8cyclictest3246794-21ntpq12:03:150
3081270993323,1cyclictest0-21swapper/009:36:150
308127099331,3cyclictest3141461-21/usr/sbin/munin09:43:150
3081273993225,3cyclictest0-21swapper/212:06:382
3081273993219,9cyclictest111788-21systemd-journal10:46:422
3081273993219,9cyclictest111788-21systemd-journal10:46:422
3081270993215,1cyclictest0-21swapper/007:43:150
3081270993215,1cyclictest0-21swapper/007:43:150
308127099311,28cyclictest259-21jbd2/mmcblk0p2-810:47:140
308127099311,28cyclictest259-21jbd2/mmcblk0p2-810:47:140
112699310,3rtkit-daemon1125-21rtkit-daemon12:30:202
308127399308,19cyclictest2243333-21munin-node09:54:472
308127299301,7cyclictest3257877-21ntpq12:18:151
308127299301,10cyclictest28-21ksoftirqd/110:56:331
308127099305,12cyclictest0-21swapper/008:26:210
3081270993014,2cyclictest0-21swapper/012:18:470
308127399293,24cyclictest3127466-21ntpq09:23:112
308127399291,6cyclictest3194483-21ntpq10:53:152
308127299296,9cyclictest3124189-21ssh09:18:141
308127099295,16cyclictest3122188-21diskmemload12:28:080
308127399285,22cyclictest0-21swapper/211:14:132
308127299288,19cyclictest3084574-21sendmail-msp07:26:191
308127299284,18cyclictest111788-21systemd-journal11:29:411
308127399275,18cyclictest0-21swapper/208:51:142
308127399275,18cyclictest0-21swapper/208:51:142
308127399274,20cyclictest0-21swapper/211:26:162
308127399274,19cyclictest259-21jbd2/mmcblk0p2-807:16:152
308127399272,5cyclictest3201204-21ssh11:03:452
308127399271,6cyclictest3246210-21grep12:03:102
308127399271,5cyclictest3227086-21ssh11:38:132
308127399270,6cyclictest3089248-21ntpq07:38:142
3081272992715,10cyclictest111788-21systemd-journal11:55:521
308127099277,10cyclictest3197415-21ssh10:58:150
308127099275,20cyclictest3084538-21apt-get07:26:180
308127399264,20cyclictest3234110-21/usr/sbin/munin11:48:082
308127399263,5cyclictest11050irq/107-eth%d10:03:102
308127399263,3cyclictest3280404-21sendmail12:46:142
308127399262,6cyclictest3159636-21sendmail-msp10:06:192
308127399262,6cyclictest0-21swapper/209:13:162
308127399262,5cyclictest3118916-21sendmail-msp09:06:172
308127399262,3cyclictest3204103-21/usr/sbin/munin11:08:152
308127399261,6cyclictest3222553-21cut11:33:092
308127399261,6cyclictest3098094-21sendmail-msp08:08:192
308127399261,6cyclictest3098094-21sendmail-msp08:08:192
308127399261,2cyclictest111788-21systemd-journal12:13:102
308127399260,10cyclictest3259924-21grep12:21:142
308127299266,16cyclictest619-21mta-sts-daemon09:41:181
3081272992614,7cyclictest261rcuc/112:32:251
308127299260,3cyclictest3211396-21ntpq11:18:141
308127099264,16cyclictest3112258-21/usr/sbin/munin08:48:090
308127099264,16cyclictest3112258-21/usr/sbin/munin08:48:090
3081270992623,1cyclictest3227005-21ntpq11:38:120
308127099260,25cyclictest0-21swapper/011:35:050
308127399255,3cyclictest0-21swapper/207:28:482
308127399254,18cyclictest0-21swapper/210:13:502
308127399253,2cyclictest0-21swapper/207:53:262
308127399252,8cyclictest3081442-21grep07:16:142
308127399251,5cyclictest3111672-21find08:43:212
308127299255,16cyclictest605-21avahi-daemon09:07:211
3081272992513,8cyclictest3254321-21ntpq12:13:161
3081272992513,6cyclictest3248504-21sendmail-msp12:06:241
308127299251,13cyclictest0-21swapper/111:03:131
308127099253,13cyclictest11050irq/107-eth%d12:38:130
308127099251,24cyclictest0-21swapper/009:51:190
308127099251,20cyclictest0-21swapper/010:33:100
308127399245,4cyclictest0-21swapper/209:38:262
308127399244,3cyclictest3230097-21aten_r2power_cu11:43:052
308127399243,7cyclictest764-21rs:main2
308127399243,3cyclictest3095296-21grep07:58:092
308127399242,4cyclictest3168187-21fschecks_time10:18:112
308127399242,21cyclictest0-21swapper/212:34:412
308127399242,17cyclictest3087609-21ld07:33:162
308127399241,6cyclictest764-21rs:main2
308127399241,5cyclictest3273975-21sed12:38:142
308127299248,14cyclictest3265196-21tune2fs12:28:081
308127299245,14cyclictest3278854-21/usr/sbin/munin12:43:201
3081272992415,7cyclictest3144168-21apt-get09:46:181
3081272992414,8cyclictest3087607-21collect207:33:161
3081272992412,8cyclictest3273852-21/usr/sbin/munin12:38:131
308127299241,17cyclictest3191273-21ssh10:48:181
308127299241,17cyclictest3191273-21ssh10:48:181
3081272992411,12cyclictest3195569-21sh10:55:531
3081272992411,10cyclictest1007-21mta-sts-daemon10:26:161
308127099241,21cyclictest191rcuc/011:53:170
308127099241,20cyclictest3183448-21ntpq10:38:150
308127099241,12cyclictest3206504-21/usr/sbin/munin11:13:150
308127399238,14cyclictest0-21swapper/208:38:202
308127399236,15cyclictest0-21swapper/210:21:172
308127399233,7cyclictest3140711-21apt-key09:41:152
308127399233,18cyclictest111788-21systemd-journal10:26:432
308127399233,17cyclictest111788-21systemd-journal10:56:332
308127399232,4cyclictest3090357-21grep07:43:092
308127399232,4cyclictest3090357-21grep07:43:092
308127399232,4cyclictest0-21swapper/211:58:142
308127399232,3cyclictest3116188-21grep08:58:272
308127399231,6cyclictest0-21swapper/207:48:222
308127399231,5cyclictest3083414-21fschecks_count07:23:122
308127399231,2cyclictest3103354-21cron08:21:132
308127399230,7cyclictest3117804-21grep09:03:102
308127399230,7cyclictest3117804-21grep09:03:102
308127299234,15cyclictest111788-21systemd-journal09:31:151
308127099236,13cyclictest3101935-21packagekitd08:16:160
308127099233,16cyclictest3260932-21cut12:23:050
308127099231,16cyclictest3115834-21/usr/sbin/munin08:58:290
308127099230,2cyclictest3118880-21idleruntime-cro09:06:140
308127099230,2cyclictest3118880-21idleruntime-cro09:06:140
308127399223,3cyclictest3123797-21tr09:18:112
308127399223,2cyclictest0-21swapper/211:18:172
308127399222,6cyclictest3129081-21sendmail-msp09:33:172
308127399222,4cyclictest3097015-21grep08:03:162
308127399222,17cyclictest3101541-21latency_hist08:16:142
308127399221,6cyclictest3183273-21uname10:38:122
308127399221,5cyclictest3214708-21fschecks_count11:23:092
308127299226,12cyclictest967-21snmpd10:14:531
308127299226,11cyclictest3149873-21aten_r2power_fr09:53:081
308127299224,13cyclictest111788-21systemd-journal08:26:211
3081272992213,8cyclictest3163241-21systemd-run10:11:141
308127299220,9cyclictest0-21swapper/108:32:221
308127099228,11cyclictest11650irq/162-mmc010:26:230
3081270992217,4cyclictest3240974-21dpkg11:56:140
308127099221,16cyclictest0-21swapper/009:38:190
308127099220,7cyclictest967-21snmpd10:19:530
308127399211,5cyclictest0-21swapper/210:43:122
308127299214,15cyclictest2243333-21munin-node09:40:001
308127299214,13cyclictest967-21snmpd10:44:311
308127299212,14cyclictest0-21swapper/110:03:131
3081272992113,7cyclictest3118916-21sendmail-msp09:13:151
308127299210,8cyclictest0-21swapper/111:35:471
308127099215,12cyclictest3091511-21sendmail-msp07:53:170
3081270992116,3cyclictest11650irq/162-mmc012:06:240
308127399204,4cyclictest0-21swapper/208:53:062
308127399202,5cyclictest0-21swapper/212:23:052
308127399201,5cyclictest3105062-21latency_hist08:26:142
308127299203,9cyclictest3242889-21ssh11:58:161
308127299203,14cyclictest3081271-21systemd-run07:16:141
308127299201,4cyclictest0-21swapper/110:18:561
308127299199,6cyclictest271ktimers/108:58:581
308127299192,15cyclictest3247528-21ssh12:03:481
308127099194,12cyclictest3105043-21sendmail-msp08:36:240
308127499181,7cyclictest0-21swapper/311:28:073
308127399181,5cyclictest3130144-21aten_r2power_fr09:28:052
308127299182,11cyclictest3154423-21/usr/sbin/munin09:58:161
308127299182,11cyclictest3154423-21/usr/sbin/munin09:58:161
3081272991810,6cyclictest0-21swapper/112:23:051
308127099189,5cyclictest3278853-21ssh12:43:200
308127099183,11cyclictest3118916-21sendmail-msp09:06:190
308127099181,5cyclictest3110548-21/usr/sbin/munin08:43:080
308127499171,9cyclictest0-21swapper/309:08:163
308127299172,2cyclictest3109807-21ntpq08:38:151
308127299172,13cyclictest3126643-21ssh09:23:051
308127299172,10cyclictest111788-21systemd-journal07:53:531
308127299171,4cyclictest3130948-21ntpq09:28:141
308127299171,4cyclictest3083947-21ntpq07:23:161
308127299171,13cyclictest3227005-21ntpq11:38:121
308127099174,11cyclictest3144200-21sendmail-msp09:56:260
308127099174,11cyclictest3144200-21sendmail-msp09:56:260
308127099173,11cyclictest0-21swapper/008:31:170
308127499164,7cyclictest0-21swapper/309:51:153
308127499163,8cyclictest0-21swapper/312:32:433
308127499163,6cyclictest0-21swapper/310:41:183
308127299168,8cyclictest0-21swapper/111:14:461
308127299162,2cyclictest3089338-21ntpq07:38:161
3081272991611,3cyclictest3172758-21sendmail_mailqu10:23:151
308127099164,11cyclictest619-21mta-sts-daemon10:43:210
308127099163,6cyclictest3231042-21/usr/sbin/munin11:43:140
308127099162,9cyclictest3124224-21ssh09:18:150
308127099162,11cyclictest111788-21systemd-journal12:11:490
308127099162,10cyclictest3210689-21ssh11:18:080
3081270991613,2cyclictest3174400-21munin-plugin-st10:26:140
308127099161,13cyclictest3215085-21/usr/sbin/munin11:23:110
112699160,2rtkit-daemon1125-21rtkit-daemon08:04:071
308127499154,5cyclictest0-21swapper/312:13:163
308127499154,5cyclictest0-21swapper/311:08:153
308127499153,7cyclictest0-21swapper/310:16:153
308127499153,7cyclictest0-21swapper/310:11:153
308127499153,5cyclictest0-21swapper/311:46:173
308127499152,7cyclictest0-21swapper/311:32:253
308127499152,7cyclictest0-21swapper/308:48:093
308127499152,7cyclictest0-21swapper/308:48:093
308127499152,6cyclictest0-21swapper/312:23:053
308127499152,5cyclictest0-21swapper/307:43:123
308127499152,5cyclictest0-21swapper/307:43:123
308127299154,9cyclictest3098094-21sendmail-msp08:08:241
308127299154,9cyclictest3098094-21sendmail-msp08:08:241
308127299152,8cyclictest69-21kswapd010:38:141
308127299151,3cyclictest28-21ksoftirqd/107:58:131
308127299150,2cyclictest3090965-21ntpq07:43:141
308127299150,2cyclictest3090965-21ntpq07:43:141
308127099159,4cyclictest111788-21systemd-journal07:48:140
308127099153,9cyclictest3089361-21/usr/sbin/munin07:38:160
308127099152,3cyclictest3095295-21fschecks_count07:58:090
308127099150,9cyclictest3129050-21sendmail09:26:140
308127499146,4cyclictest0-21swapper/309:46:183
308127499145,4cyclictest0-21swapper/309:13:153
308127499145,3cyclictest0-21swapper/310:23:133
308127499144,4cyclictest0-21swapper/311:03:453
308127499143,8cyclictest0-21swapper/307:26:183
308127499143,7cyclictest0-21swapper/311:56:143
308127499143,5cyclictest0-21swapper/311:13:123
308127499142,6cyclictest0-21swapper/309:33:153
308127299149,4cyclictest633-21gpm11:45:571
308127299147,4cyclictest0-21swapper/110:33:101
308127299144,6cyclictest3114104-21/usr/sbin/munin08:53:081
308127299143,2cyclictest28-21ksoftirqd/108:16:141
308127299142,8cyclictest28-21ksoftirqd/107:48:161
308127099145,8cyclictest3082306-21ntpq07:18:140
308127099142,9cyclictest3104330-21/usr/sbin/munin08:23:110
308127099142,4cyclictest3084545-21munin-run07:26:140
308127099141,8cyclictest3096986-21/usr/sbin/munin08:03:160
308127099140,3cyclictest3098664-21fschecks_time08:08:150
308127099140,3cyclictest3098664-21fschecks_time08:08:150
308127099140,13cyclictest0-21swapper/011:02:310
308127499135,3cyclictest0-21swapper/308:13:163
308127499134,6cyclictest0-21swapper/310:48:113
308127499134,6cyclictest0-21swapper/310:48:113
308127499133,6cyclictest0-21swapper/309:18:143
308127499133,6cyclictest0-21swapper/308:16:163
308127499133,5cyclictest0-21swapper/311:18:143
308127499133,5cyclictest0-21swapper/310:38:133
308127499133,4cyclictest0-21swapper/312:03:073
308127499133,4cyclictest0-21swapper/309:41:153
308127499133,4cyclictest0-21swapper/309:27:293
308127499132,6cyclictest0-21swapper/308:31:173
308127499132,5cyclictest0-21swapper/311:53:173
308127499132,5cyclictest0-21swapper/310:53:153
308127499132,5cyclictest0-21swapper/309:23:073
308127499131,7cyclictest0-21swapper/312:26:163
308127299135,5cyclictest0-21swapper/108:46:141
308127299132,2cyclictest0-21swapper/109:03:131
308127299132,2cyclictest0-21swapper/109:03:131
308127299131,6cyclictest3101942-21apt-get08:16:161
308127299131,2cyclictest1006-21mta-sts-daemon11:08:161
3081272991310,3cyclictest3082272-21ntp_kernel_err07:18:131
308127099134,7cyclictest0-21swapper/010:03:050
308127099130,9cyclictest0-21swapper/008:14:510
308127499125,4cyclictest0-21swapper/312:06:243
308127499124,4cyclictest0-21swapper/310:26:193
308127499124,4cyclictest0-21swapper/307:48:123
308127499124,3cyclictest0-21swapper/311:43:173
308127499123,5cyclictest0-21swapper/308:38:133
308127499123,4cyclictest0-21swapper/310:18:173
308127499122,6cyclictest0-21swapper/308:26:173
308127499122,5cyclictest0-21swapper/308:43:153
308127499121,6cyclictest0-21swapper/311:23:143
308127499121,4cyclictest0-21swapper/311:36:203
308127299121,3cyclictest28-21ksoftirqd/108:23:071
3081272991210,1cyclictest0-21swapper/111:23:091
308127499115,4cyclictest0-21swapper/312:18:103
308127499113,4cyclictest0-21swapper/307:53:213
308127499111,7cyclictest0-21swapper/310:56:333
308127499111,6cyclictest0-21swapper/309:38:063
308127499111,6cyclictest0-21swapper/307:33:163
308127499111,5cyclictest0-21swapper/310:33:143
308127499111,5cyclictest0-21swapper/307:38:103
308127499103,5cyclictest0-21swapper/310:03:103
308127499102,6cyclictest0-21swapper/308:53:073
308127499102,5cyclictest0-21swapper/308:56:163
308127499102,5cyclictest0-21swapper/308:23:063
308127499102,5cyclictest0-21swapper/308:08:113
308127499102,5cyclictest0-21swapper/308:08:113
308127499102,5cyclictest0-21swapper/307:58:083
308127499102,4cyclictest0-21swapper/308:03:063
308127499101,6cyclictest0-21swapper/312:43:203
30812749993,4cyclictest0-21swapper/307:23:083
30812749993,4cyclictest0-21swapper/307:16:153
30812749992,6cyclictest0-21swapper/312:38:123
30812749991,4cyclictest0-21swapper/309:58:143
30812749991,4cyclictest0-21swapper/309:58:143
30812749982,2cyclictest0-21swapper/307:16:143
30812749981,4cyclictest0-21swapper/309:06:143
30812749981,4cyclictest0-21swapper/309:06:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional