You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 07:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Sun Jul 13, 2025 00:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
876560992825,2cyclictest401ktimers/222:47:522
87655699275,21cyclictest311ktimers/122:22:561
87655499271,23cyclictest893761-21irqstats19:25:170
87655499270,22cyclictest0-21swapper/023:00:130
87656099261,21cyclictest1101886-21apt-get22:30:152
876556992621,3cyclictest1190974-21apt-get23:40:131
87655499261,22cyclictest1222998-21apt-get00:05:170
87656499252,3cyclictest938517-21apt-get20:10:153
87656099251,21cyclictest984389-21apt-get20:55:132
87655699252,20cyclictest953839-21apt-get20:25:131
87655699251,21cyclictest1121264-21apt-get22:45:121
87655699250,24cyclictest0-21swapper/123:56:351
87655699250,24cyclictest0-21swapper/123:56:351
876554992522,2cyclictest1031608-21latency_hist21:35:010
876554992521,3cyclictest245621450irq/127-enp0s29f1:rx-021:45:230
87655499251,3cyclictest948739-21apt-get20:20:140
87655499251,22cyclictest974638-21ps20:45:170
87655499251,22cyclictest1261078-21apt00:35:000
87655499251,21cyclictest999381-21diskmemload22:47:570
87655499251,21cyclictest999381-21diskmemload21:23:240
87655499251,21cyclictest0-21swapper/019:50:150
87656499242,2cyclictest918187-21apt-get19:50:153
876564992419,3cyclictest892851-21apt-get19:25:123
87656499241,3cyclictest1242368-21apt-get00:20:163
87656499241,21cyclictest999381-21diskmemload21:58:043
87656499241,20cyclictest1159240-21apt-get23:15:133
87656499241,20cyclictest0-21swapper/320:25:133
87656499241,20cyclictest0-21swapper/300:00:133
87656499241,19cyclictest994565-21apt-get21:05:153
87656499240,22cyclictest1223182-21/usr/sbin/munin00:05:193
87656099241,20cyclictest999381-21diskmemload23:55:092
87656099241,20cyclictest999381-21diskmemload23:55:092
87656099241,20cyclictest999381-21diskmemload22:20:182
87656099240,21cyclictest1248694-21taskset00:25:132
87655699240,23cyclictest1023299-21ssh21:25:321
87655499241,3cyclictest999381-21diskmemload23:41:480
87655499241,3cyclictest999381-21diskmemload21:39:270
87655499241,3cyclictest1188725-21ntp_states23:35:260
87655499241,2cyclictest999381-21diskmemload21:17:470
87655499241,2cyclictest933440-21apt-get20:05:150
87655499241,21cyclictest999381-21diskmemload23:26:390
87655499241,21cyclictest999381-21diskmemload23:23:220
87655499241,21cyclictest999381-21diskmemload22:05:210
87655499241,21cyclictest999381-21diskmemload21:53:530
87655499241,21cyclictest999381-21diskmemload00:27:170
87655499241,21cyclictest999381-21diskmemload00:03:480
87655499241,21cyclictest1108183-21apt-get22:35:150
87655499241,21cyclictest0-21swapper/019:45:170
87655499241,20cyclictest999381-21diskmemload00:24:250
87655499241,20cyclictest0-21swapper/023:50:010
87655499241,20cyclictest0-21swapper/023:15:020
87655499241,20cyclictest0-21swapper/022:30:180
87655499240,5cyclictest1158403-21ssh23:13:250
87655499240,4cyclictest1184121-21ssh23:34:330
87655499240,21cyclictest999381-21diskmemload21:57:540
876564992320,2cyclictest882275-21apt-get19:15:163
876564992320,2cyclictest1031816-21apt-get21:35:153
876564992319,3cyclictest1241371-21ssh00:17:573
876564992319,3cyclictest1108095-21ssh22:35:033
876564992319,2cyclictest876775-21apt-get19:10:153
876564992318,4cyclictest1145911-21ssh23:03:563
876564992318,4cyclictest1088844-21ssh22:19:563
87656499231,20cyclictest999381-21diskmemload00:25:123
87656499231,20cyclictest999381-21diskmemload00:10:103
87656499231,20cyclictest519-21gpm21:40:083
87656499230,22cyclictest1183574-21ssh23:32:533
87656499230,21cyclictest1-21systemd21:21:393
87656499230,20cyclictest1102183-21fw_forwarded_lo22:30:183
87656499230,20cyclictest0-21swapper/323:10:123
87656499230,20cyclictest0-21swapper/321:45:093
87656499230,19cyclictest0-21swapper/323:55:053
87656499230,19cyclictest0-21swapper/323:55:043
876560992321,1cyclictest401ktimers/221:12:172
876560992321,1cyclictest1226662-21rm00:05:232
876560992319,2cyclictest999381-21diskmemload21:21:562
87656099231,21cyclictest999381-21diskmemload22:08:232
87656099231,21cyclictest1240057-21ntpq00:15:232
87656099231,20cyclictest1028148-21kthreadcore21:30:182
87656099231,19cyclictest902981-21apt-get19:35:152
87656099231,19cyclictest0-21swapper/223:35:152
87656099230,22cyclictest1209781-21ssh23:54:152
87656099230,22cyclictest1119102-21/usr/sbin/munin22:40:232
87656099230,20cyclictest999381-21diskmemload00:10:032
87656099230,20cyclictest1140233-21ssh23:00:142
87656099230,20cyclictest0-21swapper/220:05:152
876556992319,2cyclictest1044412-21apt-get21:45:131
87655699231,20cyclictest1131657-21ntp_states22:50:261
87655699230,22cyclictest1106765-21ssh22:31:401
87655699230,20cyclictest0-21swapper/123:10:121
87655699230,19cyclictest0-21swapper/122:10:051
87655699230,19cyclictest0-21swapper/120:55:141
876554992320,1cyclictest0-21swapper/022:55:210
876554992319,2cyclictest999381-21diskmemload00:35:380
87655499231,2cyclictest999381-21diskmemload22:17:190
87655499231,2cyclictest999381-21diskmemload21:27:410
87655499231,2cyclictest999381-21diskmemload21:12:180
87655499231,2cyclictest897927-21apt-get19:30:130
87655499231,2cyclictest0-21swapper/022:00:160
87655499231,21cyclictest0-21swapper/023:45:110
87655499231,21cyclictest0-21swapper/023:45:110
87655499231,21cyclictest0-21swapper/022:41:410
87655499231,20cyclictest1146584-21apt-get23:05:140
87655499231,20cyclictest0-21swapper/023:56:020
87655499231,20cyclictest0-21swapper/023:56:020
87655499231,20cyclictest0-21swapper/020:25:140
87655499230,2cyclictest1042137-21ssh21:40:250
87655499230,22cyclictest1099874-21sed22:25:300
87655499230,21cyclictest999381-21diskmemload22:10:340
87655499230,21cyclictest0-21swapper/022:20:510
87655499230,21cyclictest0-21swapper/000:15:320
87655499230,19cyclictest0-21swapper/020:30:120
876564992220,1cyclictest1133879-21apt-get22:55:153
876564992219,1cyclictest999381-21diskmemload00:35:033
876564992218,3cyclictest1003851-21ssh21:10:233
876564992218,2cyclictest1172454-21ps23:25:193
876564992218,2cyclictest0-21swapper/319:20:163
87656499221,2cyclictest984389-21apt-get20:55:143
87656499221,20cyclictest999381-21diskmemload23:40:363
87656499221,20cyclictest999381-21diskmemload22:08:213
87656499221,20cyclictest0-21swapper/321:16:143
87656499221,1cyclictest1197712-21apt-get23:45:163
87656499221,1cyclictest1197712-21apt-get23:45:163
87656499220,2cyclictest999381-21diskmemload22:12:533
87656499220,2cyclictest933161-21cron20:05:013
87656499220,2cyclictest1130051-21kthreadcore22:50:213
87656499220,21cyclictest973903-21unin-run20:44:593
87656499220,20cyclictest1169430-21missed_timers23:20:203
87656499220,20cyclictest0-21swapper/322:20:053
87656499220,19cyclictest1255015-21ssh00:30:123
87656499220,19cyclictest0-21swapper/323:50:143
87656499220,19cyclictest0-21swapper/322:25:053
87656499220,19cyclictest0-21swapper/320:20:143
876560992219,2cyclictest999381-21diskmemload22:19:472
876560992219,1cyclictest0-21swapper/223:10:112
876560992218,3cyclictest1150679-21ssh23:05:252
876560992218,2cyclictest0-21swapper/219:30:132
876560992217,4cyclictest1023533-21ssh21:26:162
87656099221,1cyclictest999381-21diskmemload23:25:182
87656099221,1cyclictest999381-21diskmemload21:40:382
87656099221,1cyclictest999381-21diskmemload00:36:042
87656099220,3cyclictest989963-21ps21:00:202
87656099220,2cyclictest892203-21unin-run19:25:012
87656099220,21cyclictest999381-21diskmemload23:42:262
87656099220,21cyclictest1081511-21ssh22:13:132
87656099220,20cyclictest1031824-21ssh21:35:152
87656099220,20cyclictest0-21swapper/219:45:142
87656099220,20cyclictest0-21swapper/219:40:152
87656099220,19cyclictest1217145-21if_enp0s30f400:00:162
87656099220,19cyclictest0-21swapper/221:45:022
87656099220,19cyclictest0-21swapper/220:20:142
876556992219,2cyclictest1259731-21ssh00:30:541
876556992218,3cyclictest1030684-21ssh21:32:311
87655699221,2cyclictest973012-21ntpq20:40:231
87655699221,20cyclictest999381-21diskmemload23:26:101
87655699221,20cyclictest999381-21diskmemload22:02:101
87655699221,20cyclictest989468-21apt-get21:00:151
87655699221,1cyclictest999381-21diskmemload23:07:591
87655699221,1cyclictest999381-21diskmemload22:57:081
87655699221,1cyclictest999381-21diskmemload00:36:191
87655699221,18cyclictest0-21swapper/119:15:151
87655699220,3cyclictest1052787-21grep21:50:221
87655699220,2cyclictest999381-21diskmemload21:19:191
87655699220,2cyclictest892152-21idleruntime-cro19:25:011
87655699220,21cyclictest999381-21diskmemload23:50:181
87655699220,21cyclictest999381-21diskmemload23:02:581
87655699220,20cyclictest999381-21diskmemload00:02:071
87655699220,20cyclictest1187859-21kthreadcore23:35:211
87655699220,19cyclictest0-21swapper/122:35:161
87655699220,19cyclictest0-21swapper/121:05:151
87655699220,19cyclictest0-21swapper/120:45:131
87655699220,19cyclictest0-21swapper/120:10:151
87655499221,2cyclictest0-21swapper/022:50:160
87655499220,2cyclictest0-21swapper/020:57:440
876564992119,1cyclictest999381-21diskmemload22:45:403
876564992119,1cyclictest0-21swapper/323:05:443
876564992118,2cyclictest999381-21diskmemload21:31:093
876564992116,2cyclictest958914-21apt-get20:30:133
87656499211,1cyclictest1063461-21apt-get22:00:163
87656499211,1cyclictest0-21swapper/321:00:163
87656499211,19cyclictest0-21swapper/321:25:423
87656499210,20cyclictest999381-21diskmemload23:36:163
87656499210,1cyclictest0-21swapper/320:50:133
87656499210,19cyclictest1114837-21ssh22:40:033
876560992119,1cyclictest999381-21diskmemload00:20:032
876560992119,1cyclictest0-21swapper/223:32:252
876560992118,2cyclictest999381-21diskmemload22:02:542
876560992118,2cyclictest999362-21cron21:10:002
876560992118,2cyclictest1132464-21ssh22:51:382
87656099211,1cyclictest999381-21diskmemload22:55:542
87656099211,1cyclictest0-21swapper/223:46:472
87656099211,1cyclictest0-21swapper/223:46:472
87656099211,1cyclictest0-21swapper/221:15:122
87656099211,19cyclictest999381-21diskmemload23:20:162
87656099210,20cyclictest999381-21diskmemload21:56:012
87656099210,20cyclictest877270-21ps19:10:192
87656099210,20cyclictest1097475-21kthreadcore22:25:222
87656099210,1cyclictest999381-21diskmemload23:15:272
87656099210,1cyclictest0-21swapper/220:35:432
87656099210,19cyclictest999381-21diskmemload21:50:162
87656099210,19cyclictest0-21swapper/222:35:152
876556992119,1cyclictest999381-21diskmemload22:06:291
876556992119,1cyclictest999381-21diskmemload00:11:511
876556992119,1cyclictest0-21swapper/121:55:121
876556992119,1cyclictest0-21swapper/121:21:131
876556992119,1cyclictest0-21swapper/120:20:141
876556992119,0cyclictest0-21swapper/100:25:081
876556992118,2cyclictest999381-21diskmemload23:46:041
876556992118,2cyclictest999381-21diskmemload23:46:041
876556992118,2cyclictest1088635-21ssh22:19:161
876556992118,2cyclictest1043274-21ssh21:42:281
876556992115,5cyclictest923786-21irqcore19:55:181
87655699211,1cyclictest999381-21diskmemload23:15:151
87655699211,1cyclictest913109-21apt-get19:45:141
87655699211,1cyclictest1236087-21apt-get00:15:131
87655699211,1cyclictest1095559-21apt-get22:25:171
87655699210,3cyclictest1247368-21ssh00:21:581
87655699210,20cyclictest999381-21diskmemload22:41:431
87655699210,20cyclictest999381-21diskmemload21:36:131
87655699210,1cyclictest1226946-21strings00:05:241
87655699210,1cyclictest0-21swapper/121:14:571
87655699210,19cyclictest918669-21irqcore19:50:191
876554992118,2cyclictest0-21swapper/021:00:140
87655499210,20cyclictest968769-21idleruntime-cro20:40:000
87655499210,20cyclictest0-21swapper/020:50:130
87655499210,20cyclictest0-21swapper/020:01:180
876564992018,1cyclictest0-21swapper/321:50:253
876564992016,3cyclictest944109-21sed20:15:193
87656499200,1cyclictest0-21swapper/320:05:373
87656499200,1cyclictest0-21swapper/319:45:143
876560992018,1cyclictest0-21swapper/220:50:142
876560992018,1cyclictest0-21swapper/220:45:142
876560992017,1cyclictest0-21swapper/220:30:132
876556992017,2cyclictest877276-21tr19:10:191
87655699201,17cyclictest979266-21apt-get20:50:131
87655699200,1cyclictest999381-21diskmemload23:20:431
87655699200,1cyclictest0-21swapper/119:44:381
87655699200,1cyclictest0-21swapper/119:30:121
876554992018,1cyclictest0-21swapper/019:23:410
876554992018,1cyclictest0-21swapper/019:15:150
876554992017,2cyclictest908037-21apt-get19:40:150
876554992017,2cyclictest0-21swapper/020:10:160
876554992016,2cyclictest907762-21cron19:40:010
876554992015,2cyclictest0-21swapper/019:10:150
87655499200,1cyclictest928082-21cron20:00:010
876560991917,1cyclictest943617-21apt-get20:15:162
876560991917,1cyclictest0-21swapper/220:13:072
876560991917,1cyclictest0-21swapper/219:15:152
876560991915,2cyclictest927040-21/usr/sbin/munin19:55:212
87656099190,18cyclictest2129583-21systemd-journal20:44:592
87655699190,1cyclictest0-21swapper/119:37:391
876554991916,1cyclictest969043-21apt-get20:40:150
87655499190,1cyclictest0-21swapper/020:15:140
876564991815,1cyclictest0-21swapper/319:40:153
876560991815,2cyclictest895083-21kthreadcore19:25:182
876560991811,1cyclictest0-21swapper/220:05:002
876564991715,1cyclictest923287-21apt-get19:55:143
87656099170,15cyclictest0-21swapper/220:25:122
876556991715,1cyclictest0-21swapper/120:05:151
876556991714,1cyclictest0-21swapper/120:15:141
876554991713,2cyclictest999387-21munin-run21:10:000
876564991614,1cyclictest0-21swapper/319:35:153
876556991614,1cyclictest0-21swapper/120:30:121
87656499150,0cyclictest0-21swapper/320:35:183
876564991412,1cyclictest0-21swapper/320:45:143
876556991311,1cyclictest64-21kcompactd019:25:171
876556991311,1cyclictest0-21swapper/120:05:001
876556991310,2cyclictest0-21swapper/120:40:001
87656499128,3cyclictest902227-21unixbench_multi19:30:263
87655499115,4cyclictest876480-21latency_hist19:10:010
87656099100,9cyclictest876480-21latency_hist19:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional