You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 03:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack2slot7.osadl.org (updated Fri Sep 19, 2025 00:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3577461994121,2cyclictest0-21swapper/022:05:050
357746199372,24cyclictest0-21swapper/023:12:330
357746199360,34cyclictest0-21swapper/022:00:020
357746199355,17cyclictest3574536-1kworker/0:1H+kblockd19:25:050
357746199341,4cyclictest3714727-21ssh23:07:260
3577461993330,2cyclictest3701977-21ntpq22:52:330
3577463993223,6cyclictest0-21swapper/223:47:372
357746199326,13cyclictest3574536-1kworker/0:1H+mmc_complete20:47:260
357746199320,21cyclictest0-21swapper/023:21:150
357746199312,20cyclictest0-21swapper/022:02:270
357746199310,22cyclictest3740918-21aten_r2power_cu23:37:290
357746399295,15cyclictest11050irq/107-eth%d22:25:032
357746199293,15cyclictest3644551-21/usr/sbin/munin21:47:300
3577461992928,1cyclictest0-21swapper/023:17:330
357746199282,25cyclictest3649639-21ntpq21:52:330
357746199282,13cyclictest0-21swapper/021:27:340
357746299273,15cyclictest11050irq/107-eth%d21:35:051
357746299272,2cyclictest171rcu_preempt22:25:061
357746199272,19cyclictest0-21swapper/023:02:310
3577461992721,1cyclictest0-21swapper/000:30:510
357746199271,19cyclictest3780554-21timerwakeupswit00:22:410
357746299266,10cyclictest11050irq/107-eth%d22:02:461
357746199261,5cyclictest1008-21mta-sts-daemon00:42:340
357746199261,22cyclictest0-21swapper/023:32:290
357746399252,12cyclictest619-21mta-sts-daemon20:40:022
357746299251,7cyclictest171rcu_preempt23:00:041
3577462992512,8cyclictest111788-21systemd-journal23:07:081
357746199251,24cyclictest0-21swapper/023:42:320
357746199251,21cyclictest3574536-1kworker/0:1H+kblockd23:47:370
357746199250,20cyclictest0-21swapper/021:42:290
357746199250,18cyclictest3623354-21needreboot21:22:310
357746399249,3cyclictest11050irq/107-eth%d00:17:382
3577463992417,4cyclictest0-21swapper/223:12:332
3577463992416,6cyclictest341rcuc/222:05:052
357746299244,17cyclictest3701980-21ssh22:52:331
357746199242,21cyclictest0-21swapper/020:37:320
3577461992417,1cyclictest3684201-21gltestperf22:32:300
357746399233,15cyclictest3577414-21munin-run19:15:022
3577463992311,9cyclictest111788-21systemd-journal00:06:442
357746299237,12cyclictest122792-21ntpd00:20:051
357746299234,12cyclictest3623568-21/usr/sbin/munin21:22:351
357746299232,17cyclictest111788-21systemd-journal00:07:361
3577461992322,1cyclictest0-21swapper/019:52:240
3577461992311,4cyclictest0-21swapper/000:36:460
357746399226,14cyclictest3741764-21ntpq23:37:362
357746399225,12cyclictest3622554-21/usr/sbin/munin21:22:352
357746299222,16cyclictest1007-21mta-sts-daemon21:26:531
3577461992217,1cyclictest0-21swapper/021:32:360
357746199221,20cyclictest3763596-21awk00:02:320
3577461992212,0cyclictest0-21swapper/022:12:330
3577461992210,5cyclictest3694899-21sendmail-msp22:45:170
3577461992210,5cyclictest3694899-21sendmail-msp22:45:170
357746199219,8cyclictest3587707-21sendmail-msp19:46:040
357746199214,9cyclictest3705989-21cut22:57:280
357746399203,7cyclictest11050irq/107-eth%d00:02:342
3577463992016,2cyclictest259-21jbd2/mmcblk0p2-822:47:292
3577463992016,2cyclictest259-21jbd2/mmcblk0p2-822:47:292
357746299208,10cyclictest1007-21mta-sts-daemon23:48:101
357746299205,13cyclictest3607462-21sendmail-msp20:47:261
357746299205,12cyclictest3764048-21/usr/sbin/munin00:02:381
357746299205,12cyclictest122792-21ntpd00:17:321
3577462992018,1cyclictest1006-21mta-sts-daemon00:13:541
357746199208,10cyclictest3734190-21ssh23:28:220
3577461992019,0cyclictest0-21swapper/020:32:360
3577461992015,0cyclictest0-21swapper/022:42:340
357746399195,9cyclictest0-21swapper/200:37:372
357746399193,13cyclictest3732663-21fschecks_time23:27:302
3577463991913,5cyclictest1006-21mta-sts-daemon00:20:032
357746299198,7cyclictest3673213-21munin-plugin-st22:20:021
357746299193,13cyclictest3730771-21munin-run23:25:021
357746299192,13cyclictest3746825-21ssh23:42:581
3577462991911,5cyclictest0-21swapper/100:32:261
357746199197,5cyclictest3680953-21grep22:27:400
357746199194,13cyclictest0-21swapper/022:17:280
357746199191,6cyclictest3761257-21grep00:00:020
3577461991916,1cyclictest0-21swapper/019:57:270
357746199191,11cyclictest58-21kcompactd022:37:360
357746399184,9cyclictest3709197-21ssh23:00:052
357746399182,13cyclictest3788383-21sed00:32:402
3577463991814,2cyclictest0-21swapper/220:55:302
3577463991810,4cyclictest351ktimers/221:05:432
357746299183,12cyclictest3692101-21ssh22:42:261
357746299182,13cyclictest3646223-21ssh21:48:001
357746299182,11cyclictest3649654-21sh21:52:341
3577462991810,6cyclictest0-21swapper/121:17:401
357746199181,12cyclictest3767074-21aten_r2power_po00:07:280
357746199181,11cyclictest1007-21mta-sts-daemon20:52:320
357746199181,11cyclictest0-21swapper/022:22:300
357746399175,10cyclictest3688221-21ssh22:37:292
357746399174,11cyclictest3649183-21/usr/sbin/munin21:52:302
357746399174,10cyclictest259-21jbd2/mmcblk0p2-819:25:042
357746399173,7cyclictest3758513-21/usr/sbin/munin23:57:302
357746399173,10cyclictest3771601-21/usr/sbin/munin00:12:302
357746399172,11cyclictest3667264-21ssh22:12:362
357746399171,2cyclictest0-21swapper/222:32:282
357746399171,13cyclictest3643108-21latency_hist21:45:022
357746399171,12cyclictest3580748-21grep19:25:022
357746299173,8cyclictest3599792-21fschecks_time20:22:311
357746299173,13cyclictest3796016-21ssh00:42:351
357746299172,2cyclictest3730797-21sendmail-msp23:27:301
3577462991714,3cyclictest0-21swapper/119:25:051
3577462991714,2cyclictest1005-21mta-sts-daemon23:17:331
3577462991713,3cyclictest3719794-21cut23:12:301
3577462991712,3cyclictest0-21swapper/122:37:341
357746299171,12cyclictest3579278-21latency_hist19:20:021
357746199172,9cyclictest3602164-21/usr/sbin/munin20:27:380
357746199172,14cyclictest3616286-21/usr/sbin/munin21:15:020
3577461991712,3cyclictest11050irq/107-eth%d21:37:310
357746399169,6cyclictest11050irq/107-eth%d22:52:282
357746399166,6cyclictest3745496-21grep23:42:282
357746399165,8cyclictest3601366-21df_inode20:27:272
357746399165,10cyclictest3675641-21/usr/sbin/munin22:22:342
357746399164,9cyclictest3730931-21cat23:25:022
357746399164,9cyclictest3658104-21/usr/sbin/munin22:02:302
357746399164,8cyclictest3737753-21ssh23:32:402
357746399163,10cyclictest3692652-21/usr/sbin/munin22:42:302
357746399162,8cyclictest3606795-21/usr/sbin/munin20:42:332
357746399162,10cyclictest3643082-21sendmail-msp21:46:232
357746399161,4cyclictest3784036-21grep00:27:372
3577463991611,3cyclictest0-21swapper/223:52:362
357746299163,8cyclictest3783333-21/usr/sbin/munin00:27:311
357746299163,8cyclictest3684000-21ssh22:32:291
357746299162,7cyclictest3675268-21ssh22:22:291
357746299162,11cyclictest3740878-21/usr/sbin/munin23:37:311
357746299162,10cyclictest3590980-21basename19:55:011
357746299161,13cyclictest3666486-21cut22:12:291
357746299161,10cyclictest3790686-21ssh00:36:461
357746199165,7cyclictest3596507-21fschecks_time20:12:280
357746199164,8cyclictest3754069-21df_inode23:52:280
357746199163,10cyclictest3587045-21/usr/sbin/munin19:42:340
357746199163,10cyclictest3587045-21/usr/sbin/munin19:42:340
357746199162,2cyclictest3776267-21sed00:17:390
3577461991610,4cyclictest0-21swapper/020:17:270
112699160,4rtkit-daemon1005-21mta-sts-daemon20:30:061
112699160,2rtkit-daemon0-21swapper/119:32:091
357746499152,8cyclictest0-21swapper/322:05:053
357746499152,6cyclictest0-21swapper/322:25:033
357746399158,4cyclictest3714728-21munin-node23:07:262
357746399157,6cyclictest3590821-21/usr/sbin/munin19:52:372
357746399154,8cyclictest3636985-21/usr/sbin/munin21:37:352
357746399154,7cyclictest3631706-21/usr/sbin/munin21:32:302
357746399154,7cyclictest3589370-21latency_hist19:50:022
357746399154,7cyclictest3587318-21/usr/sbin/munin19:42:392
357746399154,7cyclictest3587318-21/usr/sbin/munin19:42:392
357746399154,6cyclictest0-21swapper/223:17:332
357746399153,8cyclictest762-21in:imuxsock21:25:482
357746399152,9cyclictest3584659-21aten2.4-expect19:37:272
357746399152,10cyclictest3594846-21fschecks_time20:07:312
3577463991511,3cyclictest3795572-21gltestperf00:42:312
357746399150,13cyclictest3601021-21cat20:25:022
357746299155,7cyclictest3580839-21apt-key19:25:021
357746299153,9cyclictest3594295-21true20:05:011
357746299153,6cyclictest3759299-21ssh23:57:371
357746299152,8cyclictest3594824-21fschecks_count20:07:311
357746299152,7cyclictest261rcuc/120:15:021
357746299152,10cyclictest3754054-21/usr/sbin/munin23:52:271
357746199154,6cyclictest3583021-21head19:32:260
357746199151,9cyclictest0-21swapper/000:12:350
357746199151,11cyclictest3595371-21/usr/sbin/munin20:07:350
112699150,2rtkit-daemon0-21swapper/220:12:312
112699150,1rtkit-daemon0-21swapper/119:14:041
357746499143,5cyclictest0-21swapper/323:32:403
357746499142,6cyclictest0-21swapper/322:57:343
357746499142,5cyclictest0-21swapper/320:27:273
357746499142,4cyclictest0-21swapper/320:47:263
357746399144,4cyclictest0-21swapper/220:55:022
357746399143,8cyclictest3592013-21/usr/sbin/munin19:57:332
357746399142,6cyclictest3619378-21grep21:17:422
3577463991411,2cyclictest1005-21mta-sts-daemon21:12:292
3577463991410,3cyclictest1008-21mta-sts-daemon20:02:402
357746399140,3cyclictest11050irq/107-eth%d21:57:292
357746299149,1cyclictest0-21swapper/122:07:401
357746299145,5cyclictest3615314-21grep21:12:301
357746299144,7cyclictest3643052-21apt21:45:011
357746299143,8cyclictest111788-21systemd-journal19:47:321
357746299143,6cyclictest3694899-21sendmail-msp22:47:341
357746299143,6cyclictest3694899-21sendmail-msp22:47:341
357746299142,9cyclictest3601101-21munin-node20:27:261
357746299141,10cyclictest3706230-21/usr/sbin/munin22:57:291
357746299141,10cyclictest3605220-21ntp_kernel_pll_20:37:371
3577462991410,3cyclictest3599082-21unixbench_multi20:17:391
357746299140,10cyclictest3587017-21needreboot19:42:331
357746299140,10cyclictest3587017-21needreboot19:42:331
357746199147,1cyclictest3618319-21/usr/sbin/munin21:17:300
357746199142,8cyclictest3581129-21latency_hist19:25:030
357746199142,7cyclictest3607436-21grep20:45:010
3577461991412,1cyclictest0-21swapper/000:30:020
3577461991410,4cyclictest0-21swapper/019:15:020
357746499134,6cyclictest0-21swapper/322:52:333
357746499134,5cyclictest0-21swapper/321:48:003
357746499134,4cyclictest0-21swapper/323:27:303
357746499132,6cyclictest0-21swapper/321:22:353
357746499132,6cyclictest0-21swapper/319:47:353
357746499132,6cyclictest0-21swapper/300:02:323
357746499132,5cyclictest0-21swapper/323:57:293
357746399137,2cyclictest0-21swapper/220:47:252
357746399134,7cyclictest3603134-21/usr/sbin/munin20:32:292
357746399134,7cyclictest3598364-21/usr/sbin/munin20:17:282
357746399132,6cyclictest3579086-21apt19:20:022
357746399132,10cyclictest3705675-21/usr/sbin/munin22:57:302
357746399131,11cyclictest3582981-21/usr/sbin/munin19:32:282
357746399131,10cyclictest3670497-21aten_r2power_cu22:17:262
357746299134,8cyclictest0-21swapper/120:55:051
357746299133,6cyclictest3653938-21ssh21:57:331
357746299132,9cyclictest3613567-21cut21:07:291
357746299132,8cyclictest3736977-21/usr/sbin/munin23:32:281
357746299132,8cyclictest3606690-21/usr/sbin/munin20:42:331
357746299131,9cyclictest3610727-21latency_hist20:55:021
357746299131,10cyclictest3591204-21/usr/sbin/munin19:57:291
357746299130,10cyclictest3584955-21cut19:37:291
357746199139,2cyclictest0-21swapper/021:07:410
357746199137,3cyclictest3593153-21/usr/sbin/munin20:02:290
357746199134,6cyclictest3584621-21/usr/sbin/munin19:37:270
357746199134,6cyclictest0-21swapper/019:17:280
357746199131,10cyclictest3600919-21latency_hist20:25:020
357746499124,4cyclictest0-21swapper/323:07:323
357746499124,4cyclictest0-21swapper/320:32:343
357746499123,6cyclictest0-21swapper/300:27:373
357746499123,5cyclictest0-21swapper/323:12:403
357746499123,5cyclictest0-21swapper/322:12:293
357746499123,5cyclictest0-21swapper/321:52:303
357746499123,4cyclictest0-21swapper/322:47:273
357746499123,4cyclictest0-21swapper/322:47:273
357746499123,4cyclictest0-21swapper/320:22:333
357746499122,6cyclictest0-21swapper/323:47:293
357746499122,6cyclictest0-21swapper/322:18:313
357746499122,6cyclictest0-21swapper/300:37:313
357746499122,5cyclictest0-21swapper/320:07:343
357746499122,5cyclictest0-21swapper/320:02:343
357746499122,5cyclictest0-21swapper/319:52:383
357746299121,9cyclictest3631476-21aten_r2power_cu21:32:271
357746199122,9cyclictest3612623-21/usr/sbin/munin21:02:320
357746499117,2cyclictest0-21swapper/300:20:053
357746499114,5cyclictest0-21swapper/321:35:053
357746499113,6cyclictest0-21swapper/319:57:333
357746499113,5cyclictest0-21swapper/323:52:303
357746499113,4cyclictest0-21swapper/320:17:383
357746499112,6cyclictest0-21swapper/322:42:303
357746499112,6cyclictest0-21swapper/322:02:283
357746499112,5cyclictest0-21swapper/322:32:293
357746499112,5cyclictest0-21swapper/322:20:403
357746499112,5cyclictest0-21swapper/321:56:193
357746499112,5cyclictest0-21swapper/321:12:323
357746499112,5cyclictest0-21swapper/300:32:273
357746499111,7cyclictest0-21swapper/319:22:313
357746499110,5cyclictest0-21swapper/323:42:283
357746399114,4cyclictest3612136-21/usr/sbin/munin21:02:242
357746299111,8cyclictest3611661-21aten_r2power_fr21:02:211
357746499103,5cyclictest0-21swapper/319:25:053
357746499103,4cyclictest0-21swapper/323:37:283
357746499103,4cyclictest0-21swapper/321:26:533
357746499103,4cyclictest0-21swapper/321:17:303
357746499103,4cyclictest0-21swapper/320:55:303
357746499103,4cyclictest0-21swapper/320:42:313
357746499103,3cyclictest0-21swapper/323:00:043
357746499103,2cyclictest0-21swapper/300:12:073
357746499102,5cyclictest0-21swapper/323:20:183
357746499102,5cyclictest0-21swapper/300:17:343
357746499102,4cyclictest0-21swapper/321:02:203
357746499102,4cyclictest0-21swapper/300:42:313
357746499101,6cyclictest0-21swapper/320:12:333
357746499101,5cyclictest0-21swapper/300:06:053
357746499101,4cyclictest0-21swapper/321:31:113
357746499100,6cyclictest0-21swapper/321:42:273
35774649993,4cyclictest0-21swapper/319:32:293
35774649993,4cyclictest0-21swapper/319:17:403
35774649993,3cyclictest0-21swapper/320:37:313
35774649993,2cyclictest0-21swapper/323:17:273
35774649992,4cyclictest0-21swapper/322:37:273
35774649991,4cyclictest0-21swapper/320:52:323
35774649990,5cyclictest0-21swapper/321:07:303
35774619992,5cyclictest1005-21mta-sts-daemon20:55:300
35774649983,4cyclictest0-21swapper/319:42:283
35774649983,4cyclictest0-21swapper/319:42:283
35774649982,4cyclictest0-21swapper/319:37:273
35774649952,1cyclictest0-21swapper/319:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional