You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-18 - 00:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack2slot7.osadl.org (updated Thu Jul 17, 2025 12:43:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1225327994222,3cyclictest0-21swapper/011:59:090
1225327993916,2cyclictest1275676-21diskstats09:27:010
122532799360,20cyclictest0-21swapper/011:43:330
122532799351,21cyclictest1302270-21grep09:57:060
122532799342,17cyclictest1371734-21/usr/sbin/munin11:17:020
122532799340,23cyclictest0-21swapper/012:41:580
1225327993318,3cyclictest1397429-21sendmail-msp11:44:140
122532799322,18cyclictest0-21swapper/012:32:010
1225327993118,2cyclictest1265127-21diskmemload11:26:560
1225327993117,10cyclictest1423235-21ssh12:09:540
1225329993024,5cyclictest1267321-21fschecks_time09:16:552
1225327993011,2cyclictest0-21swapper/011:02:020
1225327992917,2cyclictest1435993-21unixbench_multi12:22:060
122532799290,6cyclictest1284546-21/usr/sbin/munin09:36:590
122532799281,22cyclictest1375656-21aten_r2power_vo11:21:540
122532799281,18cyclictest0-21swapper/011:32:000
122532799280,16cyclictest0-21swapper/011:36:530
112699280,3rtkit-daemon1125-21rtkit-daemon08:24:511
122532799273,6cyclictest11050irq/107-eth%d12:36:580
1225327992722,1cyclictest0-21swapper/010:14:080
1225329992615,8cyclictest1397403-21idleruntime-cro11:44:072
122532799262,3cyclictest1362029-21ntpq11:06:580
122532799261,25cyclictest0-21swapper/010:11:550
1225327992610,11cyclictest0-21swapper/011:51:580
122532799253,14cyclictest1429523-21/usr/sbin/munin12:16:550
1225327992514,3cyclictest1420101-21grep12:06:580
122532799251,3cyclictest1327268-21mailstats10:27:040
122532999241,3cyclictest1420230-21irqstats12:06:592
122532799247,4cyclictest1266919-21/usr/sbin/munin09:16:530
1225327992419,2cyclictest0-21swapper/009:31:490
122532799241,2cyclictest1271263-21aten_r2power_po09:21:540
122532799241,23cyclictest0-21swapper/010:32:000
122532799241,19cyclictest1348190-21processes10:52:030
122532799240,5cyclictest1368839-21latency_hist11:14:070
122532899232,6cyclictest11050irq/107-eth%d11:51:581
122532899232,17cyclictest1251513-21sed08:32:051
1225328992320,1cyclictest0-21swapper/109:16:591
1225327992322,0cyclictest0-21swapper/009:42:030
1225327992310,1cyclictest0-21swapper/007:36:520
112699230,2rtkit-daemon1125-21rtkit-daemon10:49:011
122532999226,11cyclictest1376482-21ssh11:22:012
122532899228,1cyclictest11050irq/107-eth%d10:12:011
1225328992213,2cyclictest11050irq/107-eth%d12:36:581
122532799222,18cyclictest1343986-21/usr/sbin/munin10:47:000
122532799221,5cyclictest1236486-21/usr/sbin/munin07:47:040
1225327992213,1cyclictest1305011-21/usr/sbin/munin10:01:560
122532799221,20cyclictest0-21swapper/010:07:050
1225327992210,2cyclictest0-21swapper/009:45:270
122532999213,2cyclictest0-21swapper/212:09:542
122532799214,15cyclictest1440930-21sed12:27:060
1225327992118,2cyclictest1237349-21fschecks_count07:51:580
1225327992117,3cyclictest1240053-21unixbench_singl07:57:080
1225327992111,1cyclictest1322898-21ssh10:21:580
122532999207,2cyclictest11050irq/107-eth%d10:31:592
122532999204,12cyclictest1412807-21apt-get11:59:092
1225329992015,3cyclictest0-21swapper/212:32:002
122532899202,6cyclictest1401294-21ssh11:47:331
122532899202,15cyclictest1440521-21ssh12:27:011
122532899202,12cyclictest1234902-21/usr/sbin/munin07:42:051
122532799202,17cyclictest1352804-21timerandwakeup10:57:050
1225327992015,4cyclictest1264037-21fschecks_count09:11:590
1225327992015,4cyclictest1252323-21gltestperf08:36:540
122532999194,11cyclictest1405398-21/usr/sbin/munin11:51:582
122532999193,10cyclictest1286940-21ssh09:39:312
122532999191,15cyclictest619-21mta-sts-daemon10:27:022
122532899191,12cyclictest1286734-21latency_hist09:39:071
1225327991911,6cyclictest1259093-21grep08:56:550
122532799190,2cyclictest1338968-21aten_r2power_cu10:41:510
112699190,1rtkit-daemon0-21swapper/210:58:382
122532999183,9cyclictest1322192-21head10:21:532
122532999183,8cyclictest1448352-21ssh12:35:052
1225329991816,1cyclictest0-21swapper/208:17:072
122532899183,7cyclictest1225279-21munin-run07:14:071
122532899183,14cyclictest1257154-21cut08:51:561
122532899182,9cyclictest11050irq/107-eth%d10:27:021
122532899182,11cyclictest1305906-21/usr/sbin/munin10:02:011
1225328991815,2cyclictest1426061-21unixbench_singl12:12:061
1225328991813,3cyclictest1008-21mta-sts-daemon11:32:061
1225328991812,5cyclictest0-21swapper/109:56:581
122532799182,13cyclictest1240797-21tail08:01:570
1225327991811,5cyclictest1235120-21grep07:42:050
122532799180,2cyclictest1412300-21awk11:59:070
122532999179,5cyclictest0-21swapper/209:12:102
122532999177,7cyclictest1297050-21gltestperf09:51:562
122532999177,5cyclictest1271114-21/usr/sbin/munin09:21:572
122532999175,10cyclictest1235686-21/usr/sbin/munin07:46:542
122532999174,9cyclictest1280054-21ssh09:31:542
122532999172,9cyclictest1300888-21aten_r2power_en09:56:532
122532999172,12cyclictest1316285-21latency_hist10:14:072
122532999171,5cyclictest11050irq/107-eth%d11:31:572
122532999171,3cyclictest1430634-21grep12:17:012
122532999171,3cyclictest1249029-21grep08:26:552
1225329991711,4cyclictest0-21swapper/210:01:572
1225329991710,4cyclictest0-21swapper/209:27:002
122532999170,5cyclictest11050irq/107-eth%d11:36:562
122532899175,10cyclictest1253863-21cut08:41:561
122532899174,9cyclictest1430508-21diskmemload12:17:001
122532899174,8cyclictest1379467-21ssh11:25:351
122532899173,11cyclictest1323506-21grep10:22:051
122532899171,7cyclictest1395418-21sh11:41:591
1225328991715,1cyclictest1262398-21fschecks_count09:06:571
1225328991714,2cyclictest1248335-21idleruntime-cro08:24:061
1225328991713,3cyclictest1319006-21switchtime10:17:031
1225328991713,3cyclictest1253288-21unin-run08:39:071
1225328991711,5cyclictest1006-21mta-sts-daemon09:12:081
122532899171,10cyclictest1420192-21sh12:06:591
1225327991714,2cyclictest1225862-21fschecks_count07:16:550
1225327991712,4cyclictest1247706-21ntp_kernel_err08:21:580
1225327991710,5cyclictest0-21swapper/009:01:540
1225327991710,5cyclictest0-21swapper/009:01:540
122533099163,10cyclictest0-21swapper/312:31:593
122532999164,11cyclictest1232664-21/usr/sbin/munin07:36:552
122532999163,9cyclictest1227629-21grep07:21:562
122532999163,4cyclictest1409307-21/usr/sbin/munin11:56:522
122532999162,3cyclictest1293262-21awk09:47:002
122532999162,12cyclictest967-21snmpd10:14:272
122532999161,5cyclictest11050irq/107-eth%d12:20:492
1225329991612,3cyclictest1262568-21gltestperf09:06:582
122532999161,12cyclictest1260855-21gltestperf09:01:542
122532999161,12cyclictest1260855-21gltestperf09:01:542
122532899163,9cyclictest0-21swapper/112:42:061
1225328991613,2cyclictest1367435-21unixbench_singl11:12:051
1225328991612,3cyclictest0-21swapper/111:56:521
122532899161,13cyclictest1237350-21fschecks_count07:51:581
122532899161,11cyclictest1292755-21cut09:46:551
122532799165,9cyclictest1256672-21latency_hist08:49:070
1225327991610,5cyclictest0-21swapper/008:51:570
112699160,3rtkit-daemon1125-21rtkit-daemon10:52:232
122533099153,5cyclictest0-21swapper/308:02:063
122532999156,8cyclictest1247257-21cut08:21:552
122532999156,4cyclictest1343117-21/usr/sbin/munin10:47:002
122532999153,8cyclictest1226383-21/usr/sbin/munin07:16:592
122532999152,11cyclictest1399880-21fschecks_time11:46:572
122532999152,11cyclictest1309534-21/usr/sbin/munin10:06:552
122532999152,10cyclictest1455239-21irqstats12:41:582
1225329991512,2cyclictest1370904-21aten_r2power_vo11:16:552
1225329991512,2cyclictest1238985-21fschecks_count07:56:582
1225329991511,3cyclictest1341650-21latency_hist10:44:072
1225329991511,3cyclictest1237374-21fschecks_count07:51:582
122532999151,13cyclictest1235075-21grep07:42:052
1225329991511,3cyclictest1230208-21grep07:27:032
122532899157,4cyclictest1435225-21ssh12:21:581
122532899156,4cyclictest1244573-21/usr/sbin/munin08:12:021
122532899152,10cyclictest1271715-21/usr/sbin/munin09:21:571
122532899151,9cyclictest1299336-21ssh09:54:071
1225328991512,2cyclictest1390149-21grep11:36:561
122532899151,10cyclictest1347550-21fschecks_time10:51:551
122532899151,10cyclictest1288384-21aten_r2power_vo09:41:541
122532899150,10cyclictest1445415-21ssh12:32:001
1225327991513,1cyclictest0-21swapper/008:26:590
1225327991510,4cyclictest0-21swapper/008:31:550
112699150,2rtkit-daemon1125-21rtkit-daemon08:53:162
122533099144,3cyclictest0-21swapper/311:25:353
122533099142,7cyclictest0-21swapper/310:14:273
122533099142,7cyclictest0-21swapper/308:26:553
122533099142,6cyclictest0-21swapper/308:54:103
122533099141,7cyclictest0-21swapper/309:27:003
122532999144,8cyclictest1362140-21grep11:06:592
122532999142,9cyclictest1286515-21awk09:39:072
122532999142,9cyclictest1253049-21/usr/sbin/munin08:37:032
122532999142,11cyclictest1231319-21awk07:31:592
122532999141,3cyclictest1378822-21ssh11:24:332
122532999141,11cyclictest1439888-21fschecks_time12:26:562
122532999141,10cyclictest1255481-21grep08:46:552
122532999141,10cyclictest1243973-21cut08:11:562
122532899148,5cyclictest1311745-21sh10:09:071
122532899143,8cyclictest967-21snmpd07:37:041
122532899143,8cyclictest11050irq/107-eth%d12:01:581
122532899142,8cyclictest1238976-21/usr/sbin/munin07:56:581
122532899142,8cyclictest1229785-21/usr/sbin/munin07:26:581
122532899142,7cyclictest1276099-21ssh09:27:041
122532899142,7cyclictest1259086-21tune2fs08:56:551
122532899142,7cyclictest1226911-21grep07:17:051
122532899142,10cyclictest1231028-21/usr/sbin/munin07:31:561
122532899141,9cyclictest1240706-21/usr/sbin/munin08:01:571
122532899140,13cyclictest1331777-21grep10:32:071
122532799148,2cyclictest1262089-21/usr/sbin/munin09:06:560
122532799145,6cyclictest1242117-21/usr/sbin/munin08:06:550
122532799142,9cyclictest0-21swapper/007:22:010
122532799141,8cyclictest0-21swapper/010:34:370
122532799141,7cyclictest1297891-21timerwakeupswit09:52:060
1225327991412,1cyclictest0-21swapper/008:11:560
1225327991410,3cyclictest1245678-21gltestperf08:16:580
122532799140,9cyclictest0-21swapper/008:41:560
122533099134,5cyclictest0-21swapper/309:22:053
122533099133,6cyclictest0-21swapper/312:37:073
122533099133,5cyclictest0-21swapper/309:56:583
122533099133,5cyclictest0-21swapper/307:16:553
122533099133,4cyclictest0-21swapper/307:36:533
122533099132,4cyclictest0-21swapper/309:59:243
122533099131,5cyclictest0-21swapper/308:21:573
122532999137,5cyclictest0-21swapper/210:36:542
122532999133,8cyclictest1242783-21/usr/sbin/munin08:06:592
122532999133,4cyclictest1250302-21aten_r2power_fr08:31:532
122532999131,10cyclictest1259199-21head08:56:562
122532899139,2cyclictest0-21swapper/108:46:571
122532899133,6cyclictest1242398-21/usr/sbin/munin08:06:571
122532899133,1cyclictest11050irq/107-eth%d09:31:541
122532899132,9cyclictest1351490-21munin-node10:56:531
122532899132,6cyclictest1260514-21/usr/sbin/munin09:01:521
122532899132,6cyclictest1260514-21/usr/sbin/munin09:01:521
122532899132,5cyclictest1334746-21aten_r2power_fr10:36:531
122532899131,9cyclictest1361668-21/usr/sbin/munin11:06:541
122532899131,9cyclictest1245561-21cut08:16:581
122532899131,8cyclictest11050irq/107-eth%d11:22:011
122532899130,9cyclictest1356693-21tune2fs11:01:551
122532799134,7cyclictest0-21swapper/007:31:530
122532799131,11cyclictest1229215-21grep07:26:530
122533099123,5cyclictest0-21swapper/310:31:553
122533099123,5cyclictest0-21swapper/309:09:243
122533099123,5cyclictest0-21swapper/307:52:013
122533099123,4cyclictest0-21swapper/312:26:593
122533099123,4cyclictest0-21swapper/311:21:563
122533099123,4cyclictest0-21swapper/307:57:013
122533099122,5cyclictest0-21swapper/311:36:563
122533099122,5cyclictest0-21swapper/307:22:013
122533099121,7cyclictest0-21swapper/311:41:593
122533099121,5cyclictest0-21swapper/311:51:523
122533099120,6cyclictest0-21swapper/308:54:073
122533099120,6cyclictest0-21swapper/308:17:023
122532999128,3cyclictest0-21swapper/211:02:062
122532999123,6cyclictest1254902-21sendmail08:44:072
122532999122,3cyclictest1367030-21/usr/sbin/munin11:12:012
122532999121,8cyclictest1240742-21gltestperf08:01:572
122532899128,3cyclictest1236722-21unixbench_multi07:47:051
122532899123,7cyclictest0-21swapper/110:41:521
122532899121,10cyclictest1227236-21aten2.4-expect07:21:531
122532799121,3cyclictest171rcu_preempt07:14:070
122533099115,3cyclictest0-21swapper/309:32:013
122533099113,5cyclictest0-21swapper/309:37:033
122533099113,5cyclictest0-21swapper/308:12:043
122533099113,4cyclictest0-21swapper/312:21:543
122533099113,4cyclictest0-21swapper/312:04:323
122533099112,7cyclictest0-21swapper/311:59:073
122533099112,5cyclictest0-21swapper/309:51:553
122533099111,6cyclictest0-21swapper/311:44:193
122533099111,6cyclictest0-21swapper/310:11:573
122533099111,6cyclictest0-21swapper/308:41:563
122533099110,6cyclictest0-21swapper/309:15:193
122532899113,4cyclictest1371665-21sh11:17:011
122533099106,2cyclictest0-21swapper/312:09:543
122533099104,3cyclictest0-21swapper/310:06:543
122533099104,2cyclictest0-21swapper/307:41:593
122533099103,4cyclictest0-21swapper/308:31:593
122533099103,4cyclictest0-21swapper/308:06:583
122533099102,6cyclictest0-21swapper/311:30:573
122533099102,6cyclictest0-21swapper/310:25:453
122533099102,5cyclictest0-21swapper/312:16:523
122533099102,5cyclictest0-21swapper/311:56:593
122533099102,5cyclictest0-21swapper/310:51:573
122533099102,4cyclictest0-21swapper/311:11:533
122533099102,4cyclictest0-21swapper/308:36:143
122533099101,6cyclictest0-21swapper/310:20:563
122533099101,5cyclictest0-21swapper/309:46:303
122533099101,5cyclictest0-21swapper/309:05:063
12253309995,3cyclictest0-21swapper/311:16:573
12253309993,3cyclictest0-21swapper/311:06:533
12253309993,3cyclictest0-21swapper/309:39:313
12253309993,3cyclictest0-21swapper/309:01:533
12253309993,3cyclictest0-21swapper/309:01:533
12253309992,5cyclictest0-21swapper/308:47:053
12253309992,4cyclictest0-21swapper/307:31:553
12253309992,3cyclictest0-21swapper/310:56:543
12253309992,3cyclictest0-21swapper/310:34:353
12253309991,5cyclictest0-21swapper/311:02:043
12253309991,5cyclictest0-21swapper/307:46:533
12253309991,5cyclictest0-21swapper/307:26:503
12253309991,4cyclictest0-21swapper/310:41:563
12253309990,6cyclictest0-21swapper/312:42:013
11269990,4rtkit-daemon992-21lldpd07:11:572
12253309982,4cyclictest0-21swapper/310:47:003
12253309951,3cyclictest0-21swapper/307:14:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional