You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-21 - 23:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Tue Jan 21, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3662066995116,29cyclictest3662065-21cyclictest11:17:430
3662067994123,6cyclictest11050irq/107-eth%d11:35:201
3662066993715,3cyclictest0-21swapper/010:30:120
366206699364,20cyclictest3795597-21/usr/sbin/munin11:15:170
366206699361,22cyclictest3722851-21ntpq09:40:140
366206799333,5cyclictest171rcu_preempt10:50:121
366206699311,4cyclictest0-21swapper/012:40:160
3662067993027,2cyclictest0-21swapper/110:01:371
366206699305,24cyclictest0-21swapper/009:35:210
366206699294,7cyclictest14-21ksoftirqd/009:50:130
366206699284,16cyclictest3762010-21ntpq10:35:190
3662066992815,6cyclictest3782436-21ssh11:00:160
366206899273,18cyclictest3844269-21sh12:06:332
366206799275,14cyclictest3757953-21ntpq10:30:121
366206699272,8cyclictest14-21ksoftirqd/012:00:150
3662066992727,0cyclictest0-21swapper/010:15:190
3662066992713,5cyclictest3736294-21fschecks_count10:00:200
3662066992712,8cyclictest0-21swapper/008:25:090
366206899261,14cyclictest11050irq/107-eth%d11:36:202
3662066992617,2cyclictest0-21swapper/011:40:120
366206699261,18cyclictest0-21swapper/009:45:270
366206799251,10cyclictest0-21swapper/111:10:071
3662066992518,3cyclictest0-21swapper/012:19:130
3662066992517,1cyclictest0-21swapper/011:51:250
3662066992515,2cyclictest0-21swapper/011:35:200
366206699242,6cyclictest0-21swapper/012:35:220
366206699242,16cyclictest0-21swapper/009:55:470
366206899237,10cyclictest0-21swapper/209:20:192
366206699234,12cyclictest3852251-21fschecks_time12:15:140
3662066992320,2cyclictest0-21swapper/009:15:150
3662066992317,1cyclictest3690455-21timerandwakeup08:35:200
3662066992315,4cyclictest0-21swapper/007:36:340
366206899229,11cyclictest3828786-21open_files11:50:142
366206899225,10cyclictest11050irq/107-eth%d10:50:122
3662068992214,5cyclictest0-21swapper/212:30:162
3662067992218,3cyclictest3867119-21unixbench_multi12:30:161
3662067992214,6cyclictest619-21mta-sts-daemon09:00:161
3662067992214,4cyclictest0-21swapper/111:50:161
366206699221,20cyclictest191rcuc/009:26:320
366206699221,1cyclictest0-21swapper/012:09:100
366206699220,21cyclictest3738243-21apt-key10:01:340
366206699220,1cyclictest0-21swapper/011:26:330
3662066992117,3cyclictest0-21swapper/010:50:080
3662066992113,0cyclictest0-21swapper/012:21:550
366206699211,19cyclictest3833584-21latency11:55:150
366206699211,10cyclictest3866773-21mailstats12:30:150
366206699210,3cyclictest0-21swapper/010:55:190
366206899202,14cyclictest3662026-21munin-run07:11:322
3662068992014,4cyclictest3877089-21grep12:40:202
366206799202,11cyclictest1005-21mta-sts-daemon12:20:171
366206699202,9cyclictest0-21swapper/010:41:330
3662066992014,1cyclictest3751512-21ntpq10:20:180
366206899193,4cyclictest11050irq/107-eth%d11:12:522
366206899192,15cyclictest3743058-21tune2fs10:10:102
366206899191,5cyclictest3732831-21ssh09:55:152
3662068991914,4cyclictest1005-21mta-sts-daemon08:25:172
3662068991911,6cyclictest111788-21systemd-journal11:21:352
366206899191,12cyclictest3852980-21/usr/sbin/munin12:15:202
366206799192,12cyclictest3876646-21/usr/sbin/munin12:40:181
3662067991914,2cyclictest0-21swapper/111:00:171
366206699192,1cyclictest0-21swapper/008:05:160
3662066991911,3cyclictest3790482-21/usr/sbin/munin11:10:120
3662066991910,6cyclictest0-21swapper/007:11:320
366206699190,18cyclictest191rcuc/011:21:340
366206899184,8cyclictest3857799-21/usr/sbin/munin12:20:172
3662068991815,2cyclictest3684095-21grep08:15:212
3662068991814,3cyclictest11050irq/107-eth%d10:35:162
366206799186,8cyclictest0-21swapper/111:15:171
366206799183,13cyclictest3800863-21/usr/sbin/munin11:20:191
3662067991814,3cyclictest3838352-21cut12:00:151
366206799181,11cyclictest3767488-21cat10:41:331
366206699184,11cyclictest3677772-21apt-get07:56:340
366206699181,6cyclictest14-21ksoftirqd/009:30:090
366206699181,13cyclictest0-21swapper/009:00:210
3662066991811,2cyclictest171rcu_preempt07:15:110
366206999173,7cyclictest0-21swapper/310:30:123
366206999173,10cyclictest0-21swapper/311:35:203
366206899175,9cyclictest3800930-21/usr/sbin/munin11:20:202
366206899172,10cyclictest3747335-21ssh10:15:182
3662068991715,1cyclictest0-21swapper/212:35:232
3662068991713,3cyclictest1006-21mta-sts-daemon11:55:202
366206899170,13cyclictest3720115-21cron09:36:332
366206799174,10cyclictest3834390-21ssh11:55:221
366206799173,9cyclictest1005-21mta-sts-daemon09:50:131
366206799173,11cyclictest3748487-21munin-plugin-st10:16:331
366206799173,10cyclictest11050irq/107-eth%d12:35:221
3662067991711,4cyclictest1008-21mta-sts-daemon08:15:161
366206799170,15cyclictest3685653-21sed08:20:191
366206699179,6cyclictest3784349-21ssh11:01:340
366206699172,1cyclictest0-21swapper/010:11:320
112699170,2rtkit-daemon1125-21rtkit-daemon09:06:310
366206999166,4cyclictest0-21swapper/310:50:123
366206899165,9cyclictest3752054-21ssh10:20:222
366206899165,9cyclictest1005-21mta-sts-daemon10:01:462
366206899164,9cyclictest3664507-21/usr/sbin/munin07:20:142
366206899163,7cyclictest3841689-21ssh12:03:082
366206899163,7cyclictest3755326-21latency_hist10:26:332
3662068991612,3cyclictest3679761-21fschecks_count08:05:122
366206899161,12cyclictest3819349-21fschecks_count11:40:152
366206899161,10cyclictest3671152-21fschecks_count07:40:112
366206799166,7cyclictest3852530-21/usr/sbin/munin12:15:151
366206799163,8cyclictest3714339-21fschecks_count09:30:081
366206799162,9cyclictest3743723-21/usr/sbin/munin10:10:161
366206799162,7cyclictest3718338-21fschecks_count09:35:131
366206799160,3cyclictest0-21swapper/112:10:141
366206699165,8cyclictest3766202-21/usr/sbin/munin10:40:150
366206699162,8cyclictest0-21swapper/009:17:580
3662066991612,3cyclictest3701156-21fschecks_time09:10:170
3662066991611,2cyclictest171rcu_preempt08:15:200
112699160,2rtkit-daemon1005-21mta-sts-daemon11:22:561
112699160,0rtkit-daemon0-21swapper/207:58:262
366206999153,8cyclictest0-21swapper/311:20:193
366206999153,7cyclictest0-21swapper/311:55:153
366206999153,5cyclictest0-21swapper/311:00:203
366206999151,8cyclictest0-21swapper/312:35:143
366206899158,4cyclictest0-21swapper/209:40:132
366206899155,6cyclictest3778690-21vmstat10:55:212
366206899153,8cyclictest3766403-21sendmail_mailqu10:40:172
366206899153,6cyclictest3822920-21ssh11:43:242
366206899153,6cyclictest3809812-21rm11:30:122
3662068991512,2cyclictest3670238-21unixbench_singl07:35:202
366206899151,12cyclictest3789570-21/usr/sbin/munin11:10:142
3662068991510,4cyclictest3692280-21grep08:40:202
366206799153,9cyclictest3722462-21ssh09:40:111
366206799153,7cyclictest3751514-21ssh10:20:181
366206799153,10cyclictest3736290-21ssh10:00:201
366206799152,12cyclictest3734129-21cron09:56:321
3662067991512,2cyclictest3778608-21unixbench_multi10:55:211
3662067991511,3cyclictest3819348-21grep11:40:151
366206699158,1cyclictest171rcu_preempt12:06:330
366206699157,5cyclictest171rcu_preempt07:35:110
366206699154,1cyclictest191rcuc/007:50:180
366206699152,8cyclictest3666535-21/usr/sbin/munin07:25:190
366206699152,3cyclictest14-21ksoftirqd/007:30:150
112699150,2rtkit-daemon1125-21rtkit-daemon10:59:192
112699150,2rtkit-daemon1125-21rtkit-daemon10:34:331
112699150,2rtkit-daemon1125-21rtkit-daemon07:16:201
112699150,1rtkit-daemon0-21swapper/208:09:422
366206999144,6cyclictest0-21swapper/310:55:143
366206999144,4cyclictest0-21swapper/311:10:143
366206999144,4cyclictest0-21swapper/309:35:223
366206999143,6cyclictest0-21swapper/311:15:213
366206999143,5cyclictest0-21swapper/309:55:183
366206999142,7cyclictest0-21swapper/310:01:463
366206999142,6cyclictest0-21swapper/311:21:353
366206999141,7cyclictest0-21swapper/310:20:213
366206899146,4cyclictest3714966-21/usr/sbin/munin09:30:152
366206899144,6cyclictest3738171-21latency_hist10:01:332
366206899143,8cyclictest3697882-21cut09:00:132
366206899142,9cyclictest3784359-21sh11:01:352
366206899142,9cyclictest3730533-21latency_hist09:51:322
366206899142,8cyclictest3758358-21expr10:30:162
366206899141,3cyclictest0-21swapper/212:00:192
366206899141,10cyclictest3674932-21sshd07:50:182
3662068991410,3cyclictest0-21swapper/209:10:252
366206799146,7cyclictest3705225-21/usr/sbin/munin09:15:181
366206799142,8cyclictest3674155-21/usr/sbin/munin07:50:211
366206799142,11cyclictest3667661-21grep07:30:151
366206799142,10cyclictest111788-21systemd-journal11:01:341
3662067991412,2cyclictest1007-21mta-sts-daemon10:44:331
3662067991411,2cyclictest3679109-21grep08:00:211
366206699147,3cyclictest3692714-21awk08:45:100
366206699145,5cyclictest3682492-21ls08:11:320
366206699141,9cyclictest3672829-21fschecks_count07:45:110
366206699141,10cyclictest3694239-21munin-node08:50:140
366206699140,2cyclictest0-21swapper/008:20:170
112699140,3rtkit-daemon1008-21mta-sts-daemon12:26:332
366206999132,6cyclictest0-21swapper/309:50:083
366206999132,5cyclictest0-21swapper/310:39:533
366206999131,6cyclictest0-21swapper/310:25:573
366206899135,6cyclictest3704470-21fschecks_count09:15:122
366206899134,7cyclictest0-21swapper/207:55:212
366206899134,6cyclictest3694632-21/usr/sbin/munin08:50:162
366206899133,5cyclictest3696895-21/usr/sbin/munin08:55:182
366206899132,2cyclictest3684371-21/usr/sbin/munin08:20:082
366206899132,10cyclictest3687777-21tail08:30:292
366206899131,8cyclictest3699519-21cut09:05:252
3662068991310,2cyclictest3663718-21unin-run07:16:322
366206899130,11cyclictest3667558-21tune2fs07:30:152
366206799139,3cyclictest3693051-21gltestperf08:45:131
366206799136,6cyclictest0-21swapper/107:56:331
366206799133,8cyclictest3691425-21/usr/sbin/munin08:40:121
366206799132,8cyclictest3708937-21/usr/sbin/munin09:20:141
366206799131,9cyclictest967-21snmpd12:22:181
3662067991311,2cyclictest3695025-21ntp_kernel_err08:50:191
366206799131,10cyclictest3670190-21grep07:35:201
3662067991310,2cyclictest3687426-21cron08:26:331
3662067991310,2cyclictest1006-21mta-sts-daemon11:27:161
366206699134,8cyclictest3664988-21/usr/sbin/munin07:20:190
366206699133,6cyclictest3677544-21latency_hist07:56:330
366206699133,2cyclictest3691016-21tail08:40:100
366206699130,9cyclictest0-21swapper/011:43:240
366206699130,7cyclictest0-21swapper/010:22:200
366206999124,4cyclictest0-21swapper/312:15:203
366206999123,5cyclictest0-21swapper/312:06:323
366206999123,5cyclictest0-21swapper/309:40:133
366206999123,5cyclictest0-21swapper/308:50:183
366206999123,4cyclictest0-21swapper/310:45:483
366206999122,6cyclictest0-21swapper/312:29:203
366206999121,7cyclictest0-21swapper/309:05:333
366206999121,6cyclictest0-21swapper/308:55:103
366206899126,4cyclictest0-21swapper/207:25:172
366206899122,7cyclictest3770647-21latency_hist10:46:332
366206799129,1cyclictest0-21swapper/108:30:381
366206799128,3cyclictest3712732-21latency_hist09:26:321
366206799124,5cyclictest0-21swapper/108:10:211
366206799124,4cyclictest3825122-21munin-run11:46:321
366206799121,4cyclictest3689301-21/usr/sbin/munin08:35:181
366206799120,10cyclictest3672217-21sed07:40:191
366206699127,3cyclictest0-21swapper/008:55:100
112699120,3rtkit-daemon0-21swapper/107:08:161
366206999114,3cyclictest0-21swapper/308:45:173
366206999113,5cyclictest0-21swapper/308:05:183
366206999113,4cyclictest0-21swapper/307:35:193
366206999113,3cyclictest0-21swapper/311:48:153
366206999113,3cyclictest0-21swapper/309:58:593
366206999112,6cyclictest0-21swapper/312:20:153
366206999112,6cyclictest0-21swapper/312:10:203
366206999112,6cyclictest0-21swapper/310:35:133
366206999112,6cyclictest0-21swapper/310:10:133
366206999112,5cyclictest0-21swapper/312:00:143
366206999112,5cyclictest0-21swapper/308:30:353
366206999112,4cyclictest0-21swapper/307:20:163
366206999111,7cyclictest0-21swapper/307:55:123
366206999111,6cyclictest0-21swapper/310:16:333
366206999110,7cyclictest0-21swapper/311:30:163
366206899117,3cyclictest1125-21rtkit-daemon09:46:012
366206899115,4cyclictest0-21swapper/208:45:122
366206899113,6cyclictest3672576-21/usr/sbin/munin07:45:092
366206899111,7cyclictest3690698-21cron08:36:322
366206899111,2cyclictest0-21swapper/209:24:402
366206799116,4cyclictest0-21swapper/109:10:171
366206799112,8cyclictest3699222-21head09:05:111
366206799111,8cyclictest3679782-21fschecks_time08:05:121
366206799111,7cyclictest3664917-21/usr/sbin/munin07:20:191
366206799110,7cyclictest3755259-21ssh10:26:331
366206699112,5cyclictest3687820-21aten_r2power_vo08:30:290
366206999105,4cyclictest0-21swapper/307:30:183
366206999104,3cyclictest0-21swapper/311:01:353
366206999103,5cyclictest0-21swapper/307:16:323
366206999103,4cyclictest0-21swapper/312:40:113
366206999103,4cyclictest0-21swapper/308:35:183
366206999103,4cyclictest0-21swapper/307:45:123
366206999102,6cyclictest0-21swapper/309:20:123
366206999102,5cyclictest0-21swapper/311:40:173
366206999102,5cyclictest0-21swapper/309:15:143
366206999102,5cyclictest0-21swapper/307:40:193
366206999102,4cyclictest0-21swapper/307:56:343
366206999101,4cyclictest0-21swapper/312:22:533
366206999101,4cyclictest0-21swapper/308:22:183
366206999101,4cyclictest0-21swapper/307:50:183
366206799105,4cyclictest3726115-21ssh09:46:191
366206799105,4cyclictest3672827-21cut07:45:111
366206799101,5cyclictest3695875-21/usr/sbin/munin08:55:091
366206799101,4cyclictest3666920-21sed07:25:211
36620699993,4cyclictest0-21swapper/309:30:083
36620699993,4cyclictest0-21swapper/309:10:163
36620699993,4cyclictest0-21swapper/308:20:183
36620699993,3cyclictest0-21swapper/308:15:143
36620699991,6cyclictest0-21swapper/311:45:283
36620679995,3cyclictest3840915-21ssh12:02:031
36620699983,4cyclictest0-21swapper/308:10:163
36620699983,2cyclictest0-21swapper/308:40:203
36620699981,5cyclictest0-21swapper/307:25:093
36620699981,4cyclictest0-21swapper/309:46:203
36620699981,4cyclictest0-21swapper/309:22:253
36620699981,3cyclictest0-21swapper/309:00:113
36620699950,3cyclictest0-21swapper/307:11:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional