You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-06 - 16:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot8.osadl.org (updated Sat Dec 06, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7139332700,3sleep2713939-21idleruntime-cro09:10:002
56233899222,16cyclictest849698-21turbostat10:35:013
56233899221,16cyclictest676490-21turbostat08:40:003
562338992017,1cyclictest0-21swapper/310:52:343
56233899201,14cyclictest632842-21taskset08:05:003
56233899200,12cyclictest7534662sleep309:34:113
56233899200,12cyclictest7534662sleep309:34:113
56233899198,5cyclictest8401782sleep310:26:323
56233899194,12cyclictest663804-21turbostat08:30:013
56233899193,12cyclictest568469-21turbostat07:14:593
56233899192,13cyclictest1042232-21turbostat12:35:013
562338991916,1cyclictest0-21swapper/311:20:173
562338991916,1cyclictest0-21swapper/308:15:013
562338991912,4cyclictest626432-21turbostat08:00:013
56233899191,15cyclictest914406-21taskset11:15:123
56233899191,14cyclictest793809-21turbostat10:00:003
56233899191,14cyclictest657639-21taskset08:25:013
562338991816,1cyclictest0-21swapper/309:05:243
562338991815,1cyclictest0-21swapper/312:00:263
56233899181,14cyclictest614490-21chrt07:50:133
56233899181,12cyclictest882218-21taskset10:55:013
56233899180,9cyclictest857633-21taskset10:39:543
56233899180,12cyclictest6944812sleep308:50:263
56233899175,9cyclictest986137-21turbostat12:00:003
56233899175,9cyclictest816866-21taskset10:12:573
56233899175,7cyclictest8725382sleep310:46:443
56233899175,7cyclictest8093222sleep310:08:573
56233899175,6cyclictest7073472sleep309:00:283
56233899171,2cyclictest0-21swapper/312:18:253
56233899171,13cyclictest945939-21taskset11:34:523
56233899171,13cyclictest607854-21taskset07:44:573
56233899171,12cyclictest970218-21sleep11:50:003
56233899171,12cyclictest954209-21sleep11:40:003
56233899171,12cyclictest670016-21turbostat08:35:003
56233899171,12cyclictest650906-21taskset08:17:033
56233899171,11cyclictest0-21swapper/309:20:123
56233899170,13cyclictest833477-21chrt10:24:303
56233899170,12cyclictest9711362sleep311:50:163
56233899170,12cyclictest7841972sleep309:51:223
5770212161,3sleep2577043-21apt-get07:20:132
5770212161,3sleep2577043-21apt-get07:20:132
56233899163,7cyclictest10481812sleep312:35:403
562338991614,1cyclictest0-21swapper/309:45:183
56233899161,3cyclictest0-21swapper/312:20:123
562338991613,1cyclictest0-21swapper/312:05:223
562338991613,1cyclictest0-21swapper/310:40:013
56233899161,2cyclictest0-21swapper/312:25:153
56233899161,2cyclictest0-21swapper/311:10:123
56233899161,2cyclictest0-21swapper/308:05:123
56233899161,12cyclictest825746-21sleep10:20:013
56233899161,12cyclictest744230-21taskset09:26:123
56233899161,12cyclictest727435-21taskset09:15:223
56233899161,12cyclictest595286-21taskset07:34:033
56233899161,11cyclictest954577-21chrt11:40:133
56233899161,11cyclictest891048-21chrt11:00:183
56233899161,11cyclictest762128-21taskset09:40:073
56233899161,11cyclictest582144-21chrt07:20:213
56233899161,11cyclictest582144-21chrt07:20:213
56233899161,11cyclictest1002355-21taskset12:10:033
56233899161,10cyclictest0-21swapper/311:05:123
56233899160,3cyclictest7607412sleep309:37:303
56233899160,13cyclictest683526-21chrt08:45:163
56233899160,12cyclictest576746-21turbostat07:20:003
5576572160,3sleep30-21swapper/307:05:193
56233899151,3cyclictest0-21swapper/309:10:143
562338991513,0cyclictest0-21swapper/308:55:493
56233899151,2cyclictest0-21swapper/308:40:133
56233899151,2cyclictest0-21swapper/307:35:143
562338991512,1cyclictest0-21swapper/311:25:193
56233899151,11cyclictest613829-21chrt07:47:143
56233899150,11cyclictest794063-21chrt10:00:033
7933702140,1sleep00-21swapper/009:59:080
562338991412,0cyclictest0-21swapper/307:25:043
147598130,9rtkit-daemon944375-21ssh11:31:180
147598130,9rtkit-daemon524825-21munin-node07:05:151
147598130,4rtkit-daemon0-21swapper/111:56:311
9864282120,4sleep10-21swapper/112:00:081
9778582120,9sleep0977866-21ssh11:54:180
9641172121,7sleep1966081-21grep11:45:211
8956452121,8sleep10-21swapper/111:00:251
5767322120,9sleep2576987-21cat07:20:012
147598120,8rtkit-daemon744-21runrttasks09:39:522
147598120,8rtkit-daemon1540-21sendmail-mta11:23:492
9850032110,1sleep00-21swapper/011:57:230
7139122110,8sleep1713931-21apt09:10:001
6581832110,8sleep2658627-21cut08:25:172
147598110,6rtkit-daemon670555-21apt-get08:35:131
147598110,5rtkit-daemon214-21plymouthd12:20:530
147598110,4rtkit-daemon1000349-21ssh12:05:550
9767462100,7sleep1976755-21ssh11:51:421
8723562100,7sleep0872363-21sh10:46:130
147598100,6rtkit-daemon1540-21sendmail-mta10:58:341
147598100,3rtkit-daemon568608-21munin-node09:32:172
147598100,3rtkit-daemon568608-21munin-node09:32:162
147598100,3rtkit-daemon568608-21munin-node07:47:211
147598100,1rtkit-daemon214-21plymouthd08:43:191
147598100,1rtkit-daemon0-21swapper/107:23:151
147598100,1rtkit-daemon0-21swapper/107:23:151
889674292,4sleep2839919-21kworker/u16:3+rpciod10:59:172
833435290,2sleep2833443-21ssh10:24:272
721572290,3sleep00-21swapper/009:14:190
706859291,5sleep2706930-21/usr/sbin/munin09:00:232
639062291,4sleep0639094-21apt-get08:10:120
556524291,5sleep0556636-21fschecks_time07:05:160
14759890,6rtkit-daemon515-21gmain07:12:311
14759890,5rtkit-daemon826375-21tune2fs10:20:150
14759890,5rtkit-daemon660811-21kthreadcore08:25:181
14759890,5rtkit-daemon313-21systemd-udevd09:21:422
14759890,5rtkit-daemon214-21plymouthd09:42:450
14759890,5rtkit-daemon1-21systemd07:29:471
14759890,4rtkit-daemon799457-21python310:00:230
14759890,4rtkit-daemon759468-21ssh09:35:241
14759890,4rtkit-daemon214-21plymouthd12:11:380
14759890,4rtkit-daemon1040849-21ssh12:31:520
14759890,2rtkit-daemon214-21plymouthd10:09:250
14759890,1rtkit-daemon1474-21rtkit-daemon09:40:232
14759890,1rtkit-daemon0-21swapper/011:45:040
1026017291,5sleep11026072-21munin-run12:25:011
1024502290,2sleep21024510-21ssh12:21:292
954951281,4sleep2955890-21irqstats11:40:172
945995284,2sleep20-21swapper/211:35:002
912167280,5sleep2713921-21diskmemload11:10:402
908008283,3sleep0909335-21kthreadcore11:10:180
903800280,5sleep0904052-21ssh11:05:250
874321280,1sleep00-21swapper/010:50:140
873613280,3sleep10-21swapper/110:49:061
864989280,6sleep0713921-21diskmemload10:42:450
857784280,5sleep2857719-21apt-get10:40:022
856696280,1sleep10-21swapper/110:37:411
855191280,1sleep00-21swapper/010:35:220
850362280,5sleep2851142-21sed10:35:172
834031280,5sleep0834068-21apt-get10:25:130
719611281,5sleep1719764-21wc09:10:241
657603281,4sleep2657627-21munin-run08:25:012
615635281,4sleep2617429-21cut07:50:182
607532280,1sleep00-21swapper/007:40:510
556335281,3sleep2556368-21apt-get07:05:142
14759880,4rtkit-daemon962158-21ssh11:44:490
14759880,4rtkit-daemon881613-21ssh10:54:072
14759880,4rtkit-daemon295-21systemd-journal11:37:420
14759880,4rtkit-daemon214-21plymouthd12:25:510
14759880,4rtkit-daemon214-21plymouthd10:11:190
14759880,4rtkit-daemon214-21plymouthd08:51:431
14759880,4rtkit-daemon214-21plymouthd07:54:181
14759880,4rtkit-daemon1-21systemd12:35:151
14759880,4rtkit-daemon1-21systemd10:15:180
14759880,1rtkit-daemon0-21swapper/210:47:182
14759880,1rtkit-daemon0-21swapper/209:26:162
14759880,1rtkit-daemon0-21swapper/108:30:271
14759880,1rtkit-daemon0-21swapper/107:36:521
1017989280,1sleep21018109-21latency_hist12:20:012
921818270,2sleep1214-21plymouthd11:19:281
920858271,3sleep2920866-21ssh11:17:172
905613270,1sleep20-21swapper/211:09:032
891919270,5sleep0893756-21ssh11:00:200
889326270,1sleep00-21swapper/010:58:270
824897271,4sleep2824904-21sh10:18:022
810094271,3sleep2810131-21apt-get10:10:112
760532270,1sleep00-21swapper/009:37:040
752055270,1sleep10-21swapper/109:30:521
752055270,1sleep10-21swapper/109:30:521
738391270,4sleep1738523-21hddtemp_smartct09:25:151
706781270,4sleep1706858-21ntp_states09:00:221
677049270,5sleep0677196-21sh08:40:140
601627271,3sleep2601648-21munin-run07:40:012
595619270,3sleep0595652-21apt-get07:35:140
14759870,4rtkit-daemon720-21snmpd12:15:040
14759870,4rtkit-daemon720-21snmpd09:18:312
14759870,4rtkit-daemon720-21snmpd08:58:001
14759870,4rtkit-daemon720-21snmpd08:02:571
14759870,4rtkit-daemon568608-21munin-node09:51:070
14759870,4rtkit-daemon214-21plymouthd07:44:011
14759870,4rtkit-daemon1-21systemd10:31:270
14759870,3rtkit-daemon728342-21sh09:16:231
14759870,3rtkit-daemon568608-21munin-node11:29:030
14759870,3rtkit-daemon515-21gmain11:16:110
14759870,3rtkit-daemon456-21avahi-daemon08:15:031
14759870,3rtkit-daemon22110-21packagekitd08:21:551
14759870,3rtkit-daemon214-21plymouthd08:45:551
14759870,3rtkit-daemon1-21systemd12:00:340
14759870,3rtkit-daemon1-21systemd07:55:351
14759870,3rtkit-daemon1-21systemd07:18:421
14759870,2rtkit-daemon214-21plymouthd12:33:241
14759870,2rtkit-daemon214-21plymouthd09:49:530
1049702270,4sleep01049710-21ssh12:38:500
1032617270,1sleep20-21swapper/212:26:572
993998260,4sleep2994008-21sshd12:04:422
985758261,3sleep2214-21plymouthd11:59:172
962776260,4sleep2962902-21hddtemp_smartct11:45:182
952924260,3sleep2952932-21ssh11:37:052
952828260,1sleep10-21swapper/111:36:521
939699260,3sleep1941423-21cut11:30:181
930309260,1sleep10-21swapper/111:25:051
897109260,1sleep20-21swapper/211:02:542
880397260,3sleep1880405-21ssh10:51:191
865308260,3sleep1865316-21ssh10:43:261
847883260,1sleep10-21swapper/110:30:551
844506261,2sleep20-21swapper/210:30:202
841039260,1sleep20-21swapper/210:28:362
840065260,4sleep10-21swapper/110:26:181
816329260,1sleep10-21swapper/110:11:481
809233260,1sleep20-21swapper/210:08:402
801434260,4sleep20-21swapper/210:04:112
792735260,1sleep10-21swapper/109:57:331
792329260,4sleep2792336-21sh09:56:422
783903260,1sleep20-21swapper/209:50:412
778488260,3sleep1778685-21irqcore09:50:161
772989260,4sleep1775055-21kthreadcore09:45:191
746239260,3sleep0746402-21diskstats09:30:190
746239260,3sleep0746402-21diskstats09:30:190
737120260,1sleep0214-21plymouthd09:23:220
707612260,1sleep00-21swapper/009:03:490
701149260,1sleep20-21swapper/208:55:502
689383260,1sleep2214-21plymouthd08:50:132
689376260,1sleep00-21swapper/008:50:070
689068260,1sleep20-21swapper/208:49:172
681817260,3sleep20-21swapper/208:40:202
676410260,1sleep00-21swapper/008:39:130
657900260,4sleep0626362-21kworker/u16:1+ext4-rsv-conversion08:25:150
652999261,2sleep00-21swapper/008:20:180
651073260,1sleep00-21swapper/008:19:130
650925260,1sleep20-21swapper/208:17:192
644598260,1sleep10-21swapper/108:10:251
632879261,2sleep10-21swapper/108:05:121
632608260,1sleep00-21swapper/008:04:510
601905260,2sleep2601938-21apt-get07:40:122
595278260,1sleep00-21swapper/007:33:570
590750260,4sleep2591925-21kthreadcore07:30:192
589046260,1sleep00-21swapper/007:28:240
588813260,1sleep20-21swapper/207:25:262
576632260,1sleep00-21swapper/007:18:430
568190260,1sleep00-21swapper/007:11:370
14759860,3rtkit-daemon720-21snmpd11:25:012
14759860,3rtkit-daemon214-21plymouthd07:32:151
1017886260,1sleep10-21swapper/112:19:471
1008441261,3sleep11008447-21ssh12:11:181
1002406260,3sleep21002445-21apt-get12:10:112
970852252,1sleep2971134-21irqcore11:50:142
954834250,3sleep1954950-21cat11:40:151
824598250,2sleep1824606-21ssh10:17:251
794825251,2sleep10-21swapper/110:00:171
776562250,3sleep20-21swapper/209:47:042
762213251,2sleep1762174-21/usr/sbin/munin09:40:141
730416250,3sleep1730534-21fw_packets09:20:131
728918251,2sleep0713921-21diskmemload09:17:450
720319250,3sleep2720327-21ssh09:11:212
683224250,2sleep00-21swapper/008:45:150
676417250,3sleep20-21swapper/208:39:182
664371251,2sleep20-21swapper/208:30:182
664047250,3sleep00-21swapper/008:30:120
632621251,1sleep20-21swapper/208:05:012
626184250,1sleep00-21swapper/007:57:020
621813250,2sleep20-21swapper/207:55:192
620187250,3sleep00-21swapper/007:54:290
613923250,3sleep00-21swapper/007:48:280
568177250,3sleep20-21swapper/207:11:272
1042849250,2sleep20-21swapper/212:35:312
1041298250,3sleep20-21swapper/212:32:552
926627240,2sleep0927377-21missed_timers11:20:190
922362240,1sleep10-21swapper/111:20:131
912160240,2sleep1214-21plymouthd11:10:391
899418240,2sleep1321rcuc/111:05:181
832288240,2sleep1214-21plymouthd10:21:461
803486240,2sleep10-21swapper/110:05:181
743906240,2sleep0214-21plymouthd09:25:300
707966240,1sleep00-21swapper/009:05:140
701386240,3sleep00-21swapper/008:58:530
638491240,3sleep20-21swapper/208:05:572
637706240,2sleep0637878-21strings08:05:190
609878240,2sleep2611885-21grep07:45:172
577003240,3sleep00-21swapper/007:20:070
577003240,3sleep00-21swapper/007:20:060
1032817240,2sleep1214-21plymouthd12:27:251
1000448240,2sleep11000456-21ssh12:06:091
1000197240,2sleep20-21swapper/212:05:382
638938230,1sleep20-21swapper/208:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional