You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 10:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Thu Dec 04, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2671178992421,1cyclictest0-21swapper/319:25:473
2671178992320,1cyclictest0-21swapper/321:45:203
2671178992320,1cyclictest0-21swapper/300:00:003
2671178992219,1cyclictest0-21swapper/319:45:003
2671178992017,1cyclictest0-21swapper/323:41:403
2671178992017,1cyclictest0-21swapper/321:15:013
2671178991917,0cyclictest0-21swapper/300:15:183
2671178991916,1cyclictest0-21swapper/323:20:003
2671178991916,1cyclictest0-21swapper/323:14:593
2671178991916,1cyclictest0-21swapper/321:30:003
267117899191,14cyclictest2859847-21taskset21:30:233
267117899191,13cyclictest2698409-21taskset19:30:133
267117899188,7cyclictest31165662sleep300:12:193
267117899188,7cyclictest31165662sleep300:12:183
267117899188,6cyclictest30450882sleep323:28:433
2671178991815,1cyclictest0-21swapper/322:21:423
2671178991815,1cyclictest0-21swapper/320:05:253
267117899181,14cyclictest2902170-21chrt21:59:493
267117899181,13cyclictest2754160-21turbostat20:15:003
267117899181,12cyclictest2671332-21taskset19:10:013
267117899180,13cyclictest2785482-21taskset20:40:143
2671178991714,1cyclictest0-21swapper/323:50:173
2671178991714,1cyclictest0-21swapper/323:35:003
2671178991714,1cyclictest0-21swapper/322:00:143
2671178991714,1cyclictest0-21swapper/322:00:133
2671178991714,1cyclictest0-21swapper/320:21:423
2671178991714,1cyclictest0-21swapper/300:26:463
267117899171,12cyclictest3060618-21taskset23:37:353
267117899171,12cyclictest2926070-21taskset22:14:553
267117899170,12cyclictest2870392-21taskset21:40:013
267117899166,7cyclictest30133602sleep323:09:113
2671178991614,1cyclictest0-21swapper/300:25:003
2671178991613,1cyclictest0-21swapper/323:00:163
2671178991613,1cyclictest0-21swapper/322:55:183
2671178991613,1cyclictest0-21swapper/322:41:423
2671178991613,1cyclictest0-21swapper/321:35:163
2671178991613,1cyclictest0-21swapper/321:15:223
267117899161,12cyclictest3149716-21taskset00:34:223
267117899161,12cyclictest3102334-21chrt00:05:163
267117899161,12cyclictest3076248-21taskset23:46:573
267117899161,12cyclictest3036274-21chrt23:21:403
267117899161,12cyclictest2988859-21taskset22:52:463
267117899161,12cyclictest2956456-21chrt22:31:233
267117899161,12cyclictest2926381-21taskset22:15:033
267117899161,12cyclictest2886619-21taskset21:50:073
267117899161,12cyclictest2822128-21taskset21:07:233
267117899161,12cyclictest2809559-21taskset20:55:283
267117899161,12cyclictest2797404-21taskset20:48:553
267117899161,12cyclictest2778644-21taskset20:31:203
267117899161,12cyclictest2729708-21chrt19:55:133
267117899161,12cyclictest2729708-21chrt19:55:133
267117899161,12cyclictest2722356-21taskset19:45:193
267117899161,11cyclictest2723495-21taskset19:50:123
267117899160,12cyclictest2964121-21taskset22:35:473
267117899160,12cyclictest2838492-21chrt21:20:053
267117899160,12cyclictest2772741-21taskset20:29:563
267117899160,12cyclictest2735891-21chrt20:00:063
31017652151,5sleep23101817-21munin-run00:05:012
28545132151,10sleep12854474-21/usr/sbin/munin21:30:141
267117899156,6cyclictest31576802sleep300:39:163
2671178991513,0cyclictest0-21swapper/300:00:293
2671178991512,1cyclictest0-21swapper/320:15:183
267117899151,11cyclictest2948280-21taskset22:26:053
267117899151,11cyclictest2803357-21taskset20:50:363
267117899151,11cyclictest2710242-21taskset19:36:223
267117899151,11cyclictest2685237-21taskset19:15:433
267117899150,12cyclictest2974258-21chrt22:45:093
267117899150,12cyclictest2815783-21taskset21:00:263
267117899150,12cyclictest2784776-21chrt20:35:373
267117899150,11cyclictest2910243-21sleep22:09:553
267117899150,11cyclictest2910243-21sleep22:09:553
267117899140,11cyclictest2691573-21taskset19:21:113
147598140,9rtkit-daemon2797535-21systemd-run20:50:010
147598140,10rtkit-daemon2924376-21ssh22:10:540
147598130,9rtkit-daemon2992499-21tr22:55:180
30544152121,8sleep23053982-21/usr/sbin/munin23:35:182
26726992120,9sleep22674581-21tr19:10:172
147598120,5rtkit-daemon2948890-21ssh22:27:320
29143842110,5sleep22822340-21diskmemload22:05:222
29143842110,5sleep22822340-21diskmemload22:05:222
27670112110,8sleep02767133-21hddtemp_smartct20:25:130
27547782110,1sleep00-21swapper/020:15:150
26846912110,8sleep22679623-21/usr/sbin/munin19:15:222
26773042111,6sleep01-21systemd19:15:000
147598110,7rtkit-daemon720-21snmpd22:41:050
147598110,7rtkit-daemon2716735-21cron19:49:551
147598110,3rtkit-daemon3020025-21ssh23:11:001
147598110,2rtkit-daemon214-21plymouthd22:51:550
31571862101,2sleep00-21swapper/000:38:120
30998792100,1sleep12822340-21diskmemload00:00:381
30920192100,7sleep23092029-21ssh23:55:542
30383642100,7sleep03038607-21cut23:25:150
29742662101,5sleep02974304-21apt-get22:45:120
29254012100,7sleep12925409-21ssh22:13:231
28536272100,7sleep12845925-21kworker/u16:1+rpciod21:28:461
27977832101,6sleep02797831-21/usr/sbin/munin20:50:130
27429302100,2sleep22743955-21cut20:05:192
147598100,7rtkit-daemon2677474-21munin-node00:33:450
147598100,6rtkit-daemon3051856-21ssh23:30:421
147598100,6rtkit-daemon3031270-21irqrtprio23:20:171
147598100,6rtkit-daemon2956355-21diskmemload22:31:100
147598100,6rtkit-daemon2876528-21ssh21:41:130
147598100,6rtkit-daemon2822874-21fschecks_count21:10:141
147598100,6rtkit-daemon2805919-21kthreadcore20:55:180
147598100,5rtkit-daemon515-21gmain21:34:040
147598100,2rtkit-daemon171rcu_preempt19:25:171
3084576290,2sleep0214-21plymouthd23:52:480
3014015290,7sleep03014054-21apt23:10:120
3001086290,2sleep10-21swapper/123:00:191
2995345290,1sleep10-21swapper/122:55:231
2988850290,2sleep22988858-21ssh22:52:462
2821652290,6sleep02821885-21unixbench_multi21:05:240
2789312290,6sleep02784899-21kworker/0:1+events20:40:190
2737521290,6sleep22739508-21kthreadcore20:00:182
2736584290,6sleep12737520-21grep20:00:171
2736216290,6sleep02736583-21irqcore20:00:160
14759890,6rtkit-daemon214-21plymouthd20:07:240
14759890,5rtkit-daemon476-21wpa_supplicant20:38:090
14759890,5rtkit-daemon476-21wpa_supplicant19:42:381
14759890,5rtkit-daemon2910771-21df_inode22:05:170
14759890,5rtkit-daemon2910771-21df_inode22:05:160
14759890,5rtkit-daemon2902615-21apt-get22:00:112
14759890,5rtkit-daemon2902615-21apt-get22:00:112
14759890,5rtkit-daemon2894041-21ssh21:54:252
14759890,5rtkit-daemon2699679-21irqrtprio19:30:161
14759890,5rtkit-daemon1540-21sendmail-mta20:24:380
14759890,4rtkit-daemon3022092-21apt-get23:15:121
14759890,1rtkit-daemon214-21plymouthd21:48:392
14759890,1rtkit-daemon0-21swapper/000:05:140
3119440281,4sleep03120998-21tr00:15:200
3117551280,1sleep10-21swapper/100:14:331
3117551280,1sleep10-21swapper/100:14:331
3079259281,4sleep23080383-21cut23:50:182
3038069281,3sleep13038082-21apt-get23:25:121
2983522281,5sleep10-21swapper/122:50:171
2941565280,6sleep12941573-21ssh22:24:011
2926466281,4sleep22926500-21apt-get22:15:152
2918465281,4sleep22901853-21kworker/u16:2+xprtiod22:10:142
2907468280,6sleep02907633-21cut22:00:190
2907468280,6sleep02907633-21cut22:00:190
2838742281,4sleep12838534-21/usr/sbin/munin21:20:161
2837901280,2sleep20-21swapper/221:19:252
2821411281,4sleep12821488-21ntp_states21:05:211
2775669280,6sleep02777782-21cut20:30:190
2772594280,1sleep20-21swapper/220:28:032
2755720280,5sleep12757081-21grep20:15:161
2748631280,6sleep22749584-21cut20:10:162
2679622281,3sleep12679655-21apt-get19:15:131
14759880,4rtkit-daemon729-21lldpd22:35:120
14759880,4rtkit-daemon720-21snmpd19:55:121
14759880,4rtkit-daemon720-21snmpd19:55:121
14759880,4rtkit-daemon3134548-21df00:25:140
14759880,4rtkit-daemon3126360-21apt-get00:20:130
14759880,4rtkit-daemon2668844-21cut19:05:191
14759880,4rtkit-daemon2632404-21munin-node19:10:091
14759880,4rtkit-daemon214-21plymouthd23:05:031
14759880,4rtkit-daemon214-21plymouthd22:16:390
14759880,4rtkit-daemon214-21plymouthd20:14:070
14759880,4rtkit-daemon1-21systemd22:22:550
14759880,3rtkit-daemon2862518-21apt-get21:35:120
14759880,1rtkit-daemon0-21swapper/023:41:540
14759880,1rtkit-daemon0-21swapper/000:13:380
14759880,1rtkit-daemon0-21swapper/000:13:380
3136036270,4sleep13137969-21kthreadcore00:25:191
3133548273,2sleep20-21swapper/200:23:562
3116782270,1sleep20-21swapper/200:12:462
3116782270,1sleep20-21swapper/200:12:462
3108416270,1sleep10-21swapper/100:06:551
3083714270,1sleep12973320-21kworker/u16:0+rpciod23:50:491
3061983271,3sleep13062022-21apt-get23:40:151
3044509270,5sleep23044517-21ssh23:27:212
3037555270,1sleep00-21swapper/023:24:380
3029339271,3sleep03029343-21ssh23:19:050
2964031270,5sleep20-21swapper/222:35:272
2956665271,3sleep20-21swapper/222:32:002
2943423271,4sleep20-21swapper/222:25:172
2899713271,3sleep22899778-21ntp_states21:55:212
2894790271,3sleep00-21swapper/021:55:140
2877479270,4sleep22868499-21kworker/u16:4+xprtiod21:43:332
2852311270,1sleep00-21swapper/021:25:370
2832461270,5sleep12834404-21kthreadcore21:15:191
2831450271,4sleep014-21ksoftirqd/021:15:180
2822664270,4sleep02822813-21df_inode21:10:130
2815909270,2sleep2214-21plymouthd21:02:032
2786282273,2sleep22787302-21kthreadcore20:40:182
2785724270,4sleep12786280-21irqrtprio20:40:181
2785120271,3sleep12785186-21munin-run20:40:011
2784196271,4sleep22784271-21grep20:35:212
2703463270,4sleep02703587-21python319:30:240
26711789975,1cyclictest0-21swapper/319:10:003
14759870,4rtkit-daemon730-21ntpd21:45:560
14759870,4rtkit-daemon720-21snmpd23:31:392
14759870,4rtkit-daemon720-21snmpd19:51:521
14759870,4rtkit-daemon720-21snmpd19:22:441
14759870,3rtkit-daemon729-21lldpd21:14:112
14759870,3rtkit-daemon515-21gmain22:47:402
14759870,3rtkit-daemon295-21systemd-journal19:35:461
14759870,3rtkit-daemon2838568-21apt-get21:20:130
14759870,3rtkit-daemon2677474-21munin-node23:57:270
14759870,3rtkit-daemon1-21systemd23:01:040
14759870,2rtkit-daemon214-21plymouthd00:01:300
3127658261,2sleep13127696-21kthreadcore00:20:181
3102216260,4sleep23102333-21/usr/sbin/munin00:05:162
3092967260,4sleep10-21swapper/123:58:101
3046022261,3sleep03046176-21df23:30:120
3021640260,1sleep20-21swapper/223:14:512
3011980260,1sleep00-21swapper/023:05:590
2980812260,1sleep10-21swapper/122:47:321
2964733260,3sleep12964741-21ssh22:37:151
2950248260,1sleep10-21swapper/122:30:051
2942257260,1sleep10-21swapper/122:25:041
2939471260,3sleep22939536-21ntp_states22:20:212
2932779260,1sleep10-21swapper/122:17:071
2916984260,1sleep10-21swapper/122:07:131
2916984260,1sleep10-21swapper/122:07:131
2902573260,3sleep12868499-21kworker/u16:4+xprtiod22:00:081
2902573260,3sleep12868499-21kworker/u16:4+xprtiod22:00:081
2894920260,3sleep12895162-21cut21:55:151
2887008261,3sleep00-21swapper/021:50:170
2886577260,4sleep12876737-21kworker/u16:0+rpciod21:50:021
2876663260,4sleep12876671-21ssh21:41:321
2869150260,4sleep12869158-21ssh21:37:481
2867890261,3sleep22868141-21awk21:35:242
2860619260,1sleep20-21swapper/221:31:232
2852833260,1sleep20-21swapper/221:26:502
2838902260,3sleep22839636-21cut21:20:172
2822267260,1sleep20-21swapper/221:09:112
2810190261,2sleep12810223-21apt-get21:00:121
2809680260,1sleep20-21swapper/220:57:012
2803574260,4sleep10-21swapper/120:53:231
2803418260,1sleep20-21swapper/220:51:252
2797306260,1sleep20-21swapper/220:47:392
2767134260,3sleep12767557-21sed20:25:141
2760600260,1sleep20-21swapper/220:20:062
2742054260,3sleep12742087-21apt-get20:05:141
2735485260,4sleep0214-21plymouthd19:58:160
2735485260,4sleep0214-21plymouthd19:58:160
2723459261,2sleep22723492-21apt-get19:50:132
2722759260,1sleep20-21swapper/219:45:232
2717035260,3sleep02716752-21apt-get19:45:010
2716550260,1sleep00-21swapper/019:42:420
2715628260,1sleep20-21swapper/219:40:192
2710303260,4sleep20-21swapper/219:37:102
2710202260,1sleep00-21swapper/019:35:520
2698070260,1sleep00-21swapper/019:29:270
2698027260,1sleep2214-21plymouthd19:28:522
2691677260,1sleep00-21swapper/019:22:330
2691619260,1sleep20-21swapper/219:21:472
14759860,3rtkit-daemon214-21plymouthd23:45:160
14759860,2rtkit-daemon3059730-21ssh23:35:330
14759860,2rtkit-daemon1540-21sendmail-mta21:01:270
3157419250,3sleep20-21swapper/200:38:422
3156235251,2sleep13156242-21diskmemload00:35:571
3148755250,3sleep10-21swapper/100:32:091
3123462250,3sleep23123711-21tail00:15:262
3117761250,3sleep13117975-21ssh00:15:011
3076168251,2sleep13076176-21ssh23:46:481
3071266251,2sleep20-21swapper/223:45:162
3059344250,2sleep10-21swapper/123:35:251
3036108250,3sleep20-21swapper/223:21:202
3012736251,2sleep20-21swapper/223:07:462
3005080250,3sleep23005088-21ssh23:03:282
2996525250,3sleep22996533-21ssh22:57:032
2971372250,2sleep12971455-21ntp_states22:40:191
2967624250,3sleep22969230-21tr22:40:162
2884410250,3sleep10-21swapper/121:46:061
2807234250,3sleep12808873-21load20:55:191
2778764250,1sleep20-21swapper/220:32:522
2757083250,2sleep20-21swapper/220:15:172
2729673250,2sleep20-21swapper/219:55:142
2729673250,2sleep20-21swapper/219:55:132
2729155250,3sleep00-21swapper/019:51:430
2698373251,1sleep20-21swapper/219:30:132
2685366250,3sleep00-21swapper/019:17:200
2666025250,2sleep00-21swapper/019:05:180
2665344250,1sleep20-21swapper/219:05:172
3140770240,3sleep20-21swapper/200:27:122
3063260241,1sleep20-21swapper/223:40:192
3021980240,2sleep20-21swapper/223:15:042
2778803240,3sleep10-21swapper/120:33:241
2762647240,1sleep10-21swapper/120:20:211
3141982230,1sleep20-21swapper/200:30:012
2794846230,1sleep10-21swapper/120:45:181
2748223230,1sleep10-21swapper/120:10:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional