You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-13 - 00:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Thu Jun 12, 2025 12:41:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1155954996553,6cyclictest0-21swapper/211:12:442
1155953995042,3cyclictest0-21swapper/108:42:401
1155953994941,5cyclictest1217872-21systemd-run09:50:011
1155953994941,5cyclictest1217872-21systemd-run09:50:011
115595399493,19cyclictest1236244-21ssh10:17:431
115595399493,19cyclictest1236244-21ssh10:17:431
1155953994825,19cyclictest1173950-21systemd-run08:10:011
1155952994838,6cyclictest151ktimers/009:07:430
1155954994740,4cyclictest1211253-21kworker/u8:6+xprtiod09:58:212
1155953994738,6cyclictest1337092-21unin-run12:40:021
1155953994738,6cyclictest1-21systemd09:30:021
1155953994738,4cyclictest0-21swapper/107:27:401
1155953994725,19cyclictest0-21swapper/108:55:011
1155953994721,23cyclictest474-21in:imuxsock10:01:011
1155952994728,13cyclictest12450irq/32-eth012:17:490
1155954994639,3cyclictest0-21swapper/212:32:382
1155953994640,4cyclictest1156165-21kworker/u8:8-xprtiod09:58:211
1155953994638,5cyclictest422-21dbus-daemon08:05:021
1155952994634,9cyclictest1300555-21unixbench_multi11:52:570
1155953994537,5cyclictest1196758-21needreboot09:17:401
1155953994522,20cyclictest1240990-21cron10:25:001
1155953994522,18cyclictest0-21swapper/108:17:431
115595399452,19cyclictest1229652-21ssh10:07:481
115595399452,10cyclictest1300084-21ssh11:52:491
1155953994520,22cyclictest349448-21cups-browsed07:13:201
1155954994436,5cyclictest1170959-21systemd-run08:00:022
1155953994435,6cyclictest421-21avahi-daemon10:40:011
115595399443,18cyclictest1219742-21ssh09:52:451
115595399443,18cyclictest1219742-21ssh09:52:451
115595399442,23cyclictest1212998-21ssh09:42:431
115595399442,23cyclictest1212998-21ssh09:42:431
115595399442,16cyclictest1331422-21ssh12:32:461
115595399442,14cyclictest1315602-21ntpq12:12:421
1155953994419,22cyclictest0-21swapper/110:35:011
1155953994417,23cyclictest0-21swapper/108:35:011
1155954994335,5cyclictest1207816-21systemd-run09:35:022
1155954994335,4cyclictest0-21swapper/211:57:472
1155954994332,8cyclictest0-21swapper/209:45:012
1155954994332,8cyclictest0-21swapper/209:45:012
115595399439,11cyclictest1303251-21/usr/sbin/munin11:57:341
1155953994335,5cyclictest1187944-21fschecks_count08:57:371
1155953994335,4cyclictest0-21swapper/111:05:021
1155953994334,7cyclictest1323413-21sh12:22:411
115595399433,21cyclictest1327409-21sshd12:27:431
115595399431,14cyclictest69-21kswapd012:07:471
1155952994331,9cyclictest0-21swapper/011:30:010
1155954994234,5cyclictest1157461-21systemd-run07:15:012
1155954994234,4cyclictest0-21swapper/212:07:492
115595399423,12cyclictest1275845-21ssh11:17:491
115595399422,16cyclictest1285906-21rm11:32:471
115595399422,15cyclictest1244207-21idleruntime-cro10:30:011
115595399422,14cyclictest1200062-21ssh09:22:461
1155953994220,19cyclictest437-21mta-sts-daemon09:31:201
1155953994217,3cyclictest0-21swapper/110:52:561
1155954994132,6cyclictest1283881-21systemd-run11:30:012
115595399415,31cyclictest1296605-21ssh11:47:421
115595399412,18cyclictest1293065-21awk11:42:461
115595399412,12cyclictest1289317-21ssh11:37:421
1155953994121,17cyclictest1268434-21aten_r2power_fr11:07:331
1155953994115,23cyclictest955-21mta-sts-daemon11:21:141
1155953994113,24cyclictest0-21swapper/109:07:491
1155953994112,5cyclictest1191927-21diskmemload12:17:461
115595399411,13cyclictest1252177-21tail10:42:331
1155954994032,5cyclictest453-21systemd-logind10:02:292
115595399404,12cyclictest1193899-21ssh09:12:541
115595399404,10cyclictest422-21dbus-daemon10:13:441
1155953994032,5cyclictest1178457-21sh08:25:011
1155953994032,5cyclictest0-21swapper/107:20:011
1155953994031,6cyclictest1255596-21fschecks_time10:47:411
115595399403,10cyclictest421-21avahi-daemon09:37:461
115595399403,10cyclictest421-21avahi-daemon09:37:461
1155953994019,3cyclictest0-21swapper/111:12:501
1155953994016,20cyclictest959-21mta-sts-daemon07:57:441
1155953994014,3cyclictest0-21swapper/107:40:011
115595399401,13cyclictest1307731-21ssh12:02:421
115595299404,31cyclictest1278981-21ssh11:22:450
1155952994034,4cyclictest422-21dbus-daemon08:10:010
1155954993932,4cyclictest1254147-21cut10:45:012
1155954993931,4cyclictest0-21swapper/209:17:442
1155953993930,6cyclictest1190428-21cron09:05:011
1155953993917,2cyclictest0-21swapper/107:42:521
1155953993914,5cyclictest0-21swapper/108:12:381
115595399391,15cyclictest1282716-21grep11:27:541
1155952993933,4cyclictest1244184-21cron10:30:010
1155952993925,12cyclictest1188915-21latency_hist09:00:010
1155952993924,3cyclictest0-21swapper/009:35:020
1155954993832,3cyclictest0-21swapper/210:27:452
1155954993831,4cyclictest1238368-21kworker/u8:6-xprtiod10:40:012
1155954993831,4cyclictest0-21swapper/210:07:512
1155954993830,5cyclictest1260693-21cut10:55:012
1155954993830,5cyclictest1175443-21systemd-run08:15:012
1155953993817,3cyclictest0-21swapper/110:57:431
115595399381,18cyclictest349448-21cups-browsed08:37:521
1155952993829,6cyclictest349448-21cups-browsed10:08:450
1155952993822,11cyclictest12450irq/32-eth010:52:490
1155954993729,5cyclictest1178434-21cron08:25:012
1155954993728,6cyclictest421-21avahi-daemon10:17:362
1155954993728,6cyclictest421-21avahi-daemon10:17:362
1155954993728,6cyclictest1335869-21unixbench-2d12:37:562
1155953993729,5cyclictest1-21systemd08:30:021
1155952993731,4cyclictest956-21mta-sts-daemon11:32:490
1155952993731,4cyclictest1162014-21latency_hist07:30:020
115595299372,23cyclictest1272336-21ssh11:12:410
1155954993631,2cyclictest0-21swapper/211:35:012
1155954993629,5cyclictest0-21swapper/212:20:012
1155954993627,6cyclictest1269284-21mailstats11:07:502
1155954993625,8cyclictest1162757-21needreboot07:32:402
1155954993625,8cyclictest1162757-21needreboot07:32:402
115595499362,28cyclictest657-21snmpd07:52:472
1155954993615,5cyclictest36-21ksoftirqd/208:37:552
115595299363,28cyclictest1292989-21ssh11:42:430
115595299363,26cyclictest1246224-21ssh10:32:520
1155952993624,9cyclictest0-21swapper/009:45:000
1155952993624,9cyclictest0-21swapper/009:45:000
1155952993612,5cyclictest14-21ksoftirqd/008:27:430
1155952993611,7cyclictest14-21ksoftirqd/007:37:430
1155954993529,3cyclictest0-21swapper/207:40:012
1155954993527,6cyclictest1155951-21cyclictest12:12:412
1155954993527,5cyclictest1301668-21ssh11:55:022
1155952993529,4cyclictest1157455-21systemd-run07:15:010
1155952993527,5cyclictest349448-21cups-browsed10:14:270
1155952993513,12cyclictest14-21ksoftirqd/007:23:050
1155952993512,5cyclictest14-21ksoftirqd/009:27:130
1155954993428,3cyclictest0-21swapper/212:30:012
1155954993426,4cyclictest959-21mta-sts-daemon10:21:442
1155954993412,12cyclictest36-21ksoftirqd/208:47:442
1155953993427,4cyclictest1185999-21latency_hist08:50:021
115595299349,4cyclictest14-21ksoftirqd/009:24:460
1155952993427,4cyclictest1184439-21munin-plugin-st08:45:010
1155952993422,4cyclictest1333120-21systemd12:35:020
1155952993420,10cyclictest0-21swapper/012:12:380
1155952993411,5cyclictest14-21ksoftirqd/007:47:570
1155954993325,5cyclictest349448-21cups-browsed09:52:182
1155954993325,5cyclictest349448-21cups-browsed09:52:182
1155954993325,3cyclictest0-21swapper/212:22:532
1155954993324,5cyclictest1278803-21needreboot11:22:382
1155954993312,5cyclictest36-21ksoftirqd/209:22:462
1155954993312,4cyclictest36-21ksoftirqd/207:42:412
1155954993312,13cyclictest36-21ksoftirqd/211:15:192
1155954993311,5cyclictest36-21ksoftirqd/211:45:382
1155954993311,13cyclictest36-21ksoftirqd/209:30:012
1155953993322,8cyclictest1169429-21/usr/sbin/munin07:55:021
115595299339,7cyclictest14-21ksoftirqd/011:40:010
1155952993326,4cyclictest1303381-21fschecks_time11:57:360
1155952993324,6cyclictest349448-21cups-browsed09:14:470
1155952993318,4cyclictest1179952-21kworker/u8:12-rpciod09:55:410
1155952993317,13cyclictest1210159-21timerwakeupswit09:37:570
1155952993317,13cyclictest1210159-21timerwakeupswit09:37:570
115595299331,26cyclictest1216365-21ssh09:47:430
115595299331,26cyclictest1216365-21ssh09:47:430
1155952993312,4cyclictest14-21ksoftirqd/010:47:500
1155952993311,6cyclictest14-21ksoftirqd/010:57:510
1155952993311,5cyclictest14-21ksoftirqd/008:52:480
1155952993311,5cyclictest14-21ksoftirqd/007:57:510
115595499329,5cyclictest36-21ksoftirqd/207:22:582
1155954993226,4cyclictest1155951-21cyclictest10:10:342
1155954993224,4cyclictest0-21swapper/209:37:432
1155954993224,4cyclictest0-21swapper/209:37:432
1155954993217,9cyclictest1262606-21ntpq10:57:462
1155954993213,4cyclictest36-21ksoftirqd/210:47:402
1155954993212,4cyclictest36-21ksoftirqd/211:45:012
1155954993211,5cyclictest36-21ksoftirqd/208:57:462
1155954993211,4cyclictest36-21ksoftirqd/210:34:552
1155954993210,4cyclictest36-21ksoftirqd/207:27:372
1155954993210,3cyclictest36-21ksoftirqd/211:00:062
115595299329,6cyclictest14-21ksoftirqd/011:49:560
115595299329,6cyclictest14-21ksoftirqd/010:36:270
115595299329,6cyclictest14-21ksoftirqd/009:02:540
115595299329,5cyclictest14-21ksoftirqd/009:50:040
115595299329,5cyclictest14-21ksoftirqd/009:50:040
115595299328,5cyclictest14-21ksoftirqd/010:01:180
1155952993224,6cyclictest1325809-21sshd12:25:420
1155952993224,5cyclictest349448-21cups-browsed11:00:180
1155952993219,5cyclictest422-21dbus-daemon12:06:120
1155952993211,5cyclictest14-21ksoftirqd/012:39:370
1155952993211,5cyclictest14-21ksoftirqd/011:17:510
1155952993210,5cyclictest14-21ksoftirqd/011:07:120
1155952993210,5cyclictest14-21ksoftirqd/009:17:450
1155952993210,5cyclictest14-21ksoftirqd/007:32:450
1155952993210,5cyclictest14-21ksoftirqd/007:32:450
115595499319,4cyclictest36-21ksoftirqd/208:52:402
1155954993125,3cyclictest0-21swapper/209:15:012
1155954993124,3cyclictest0-21swapper/208:20:022
1155954993123,5cyclictest1288793-21head11:37:342
115595299319,7cyclictest14-21ksoftirqd/008:17:410
115595299319,5cyclictest14-21ksoftirqd/012:21:330
115595299318,7cyclictest14-21ksoftirqd/010:16:370
115595299318,7cyclictest14-21ksoftirqd/010:16:370
1155952993120,7cyclictest1239565-21sh10:22:430
1155952993110,5cyclictest14-21ksoftirqd/010:40:350
1155952993110,5cyclictest14-21ksoftirqd/008:47:440
115595499309,5cyclictest36-21ksoftirqd/208:27:352
115595499306,7cyclictest1215064-21sh09:46:102
115595499306,7cyclictest1215064-21sh09:46:102
1155954993022,5cyclictest422-21dbus-daemon07:17:522
1155954993020,6cyclictest1181450-21systemd-run08:35:012
115595299308,5cyclictest14-21ksoftirqd/012:02:180
115595299307,4cyclictest14-21ksoftirqd/008:32:460
1155952993023,5cyclictest1181961-21fschecks_time08:37:440
1155954992914,10cyclictest1189836-21ntpq09:02:512
1155954992912,13cyclictest422-21dbus-daemon08:42:402
1155954992910,4cyclictest36-21ksoftirqd/208:02:352
115595399292,20cyclictest1162862-21sshd07:32:441
115595399292,20cyclictest1162862-21sshd07:32:441
115595299298,5cyclictest14-21ksoftirqd/008:02:430
1155952992922,4cyclictest1158983-21systemd-run07:20:010
1155952992921,5cyclictest956-21mta-sts-daemon08:13:080
115595499287,4cyclictest36-21ksoftirqd/212:00:062
1155954992820,5cyclictest1167412-21ntpq07:47:592
1155952992821,5cyclictest349448-21cups-browsed07:40:190
1155952992812,3cyclictest171rcu_preempt07:52:500
115595499279,4cyclictest36-21ksoftirqd/209:07:482
115595499279,4cyclictest36-21ksoftirqd/208:07:442
1155952992716,7cyclictest0-21swapper/008:25:010
1155953992618,5cyclictest349448-21cups-browsed07:22:191
115595299266,9cyclictest151ktimers/007:10:010
1155953992519,3cyclictest0-21swapper/107:50:011
1155953992317,3cyclictest0-21swapper/107:10:011
1155954992010,7cyclictest1155965-21munin-run07:10:022
115595599181,7cyclictest0-21swapper/309:17:413
115595599162,9cyclictest0-21swapper/309:58:193
115595599162,6cyclictest0-21swapper/311:52:463
115595599153,6cyclictest0-21swapper/312:17:523
115595599152,6cyclictest0-21swapper/312:12:413
115595599151,8cyclictest0-21swapper/310:52:563
115595599151,7cyclictest0-21swapper/310:02:193
115595599151,6cyclictest0-21swapper/311:02:463
115595599143,5cyclictest0-21swapper/308:02:423
115595599142,6cyclictest0-21swapper/310:22:423
115595599142,5cyclictest0-21swapper/308:57:423
115595599141,7cyclictest0-21swapper/307:27:433
115595599141,6cyclictest0-21swapper/310:37:493
115595599141,6cyclictest0-21swapper/307:47:573
115595599141,5cyclictest0-21swapper/308:52:433
115595599141,5cyclictest0-21swapper/308:07:533
115595599133,6cyclictest0-21swapper/309:32:363
115595599132,7cyclictest0-21swapper/310:12:443
115595599132,6cyclictest0-21swapper/312:22:493
115595599132,6cyclictest0-21swapper/311:07:503
115595599132,6cyclictest0-21swapper/307:23:063
115595599132,5cyclictest0-21swapper/309:12:573
115595599131,7cyclictest0-21swapper/307:42:453
115595599131,6cyclictest0-21swapper/310:47:473
115595599131,6cyclictest0-21swapper/309:27:443
115595599131,6cyclictest0-21swapper/307:57:453
115595599131,6cyclictest0-21swapper/307:37:473
115595599131,5cyclictest0-21swapper/307:17:473
115595599122,6cyclictest0-21swapper/312:27:313
115595599122,6cyclictest0-21swapper/310:17:443
115595599122,6cyclictest0-21swapper/310:17:443
115595599122,6cyclictest0-21swapper/309:37:443
115595599122,6cyclictest0-21swapper/309:37:443
115595599122,5cyclictest0-21swapper/309:22:433
115595599121,7cyclictest0-21swapper/307:52:463
115595599121,6cyclictest0-21swapper/312:07:433
115595599121,6cyclictest0-21swapper/311:42:433
115595599121,6cyclictest0-21swapper/311:22:473
115595599121,6cyclictest0-21swapper/310:32:473
115595599121,6cyclictest0-21swapper/309:52:533
115595599121,6cyclictest0-21swapper/309:52:533
115595599121,6cyclictest0-21swapper/308:32:453
115595599121,6cyclictest0-21swapper/308:22:483
115595599121,5cyclictest0-21swapper/307:32:423
115595599121,5cyclictest0-21swapper/307:32:423
115595599112,6cyclictest0-21swapper/312:02:423
115595599112,6cyclictest0-21swapper/308:27:423
115595599112,5cyclictest0-21swapper/311:32:363
115595599112,5cyclictest0-21swapper/311:11:473
115595599112,5cyclictest0-21swapper/308:42:423
115595599111,6cyclictest0-21swapper/311:57:433
115595599111,6cyclictest0-21swapper/311:47:503
115595599111,6cyclictest0-21swapper/311:27:343
115595599111,6cyclictest0-21swapper/311:17:473
115595599111,6cyclictest0-21swapper/310:57:413
115595599111,6cyclictest0-21swapper/310:42:423
115595599111,6cyclictest0-21swapper/310:27:333
115595599111,6cyclictest0-21swapper/308:37:573
115595599111,6cyclictest0-21swapper/307:12:463
115595599111,5cyclictest0-21swapper/309:02:503
115595599101,6cyclictest0-21swapper/312:32:333
115595599101,6cyclictest0-21swapper/310:05:073
115595599101,6cyclictest0-21swapper/309:47:363
115595599101,6cyclictest0-21swapper/309:47:363
115595599101,6cyclictest0-21swapper/309:42:433
115595599101,6cyclictest0-21swapper/309:42:433
115595599101,5cyclictest0-21swapper/312:36:423
115595599101,5cyclictest0-21swapper/308:47:413
115595599101,5cyclictest0-21swapper/308:12:463
11559559991,5cyclictest0-21swapper/311:35:383
11559559991,5cyclictest0-21swapper/309:07:413
11559559991,5cyclictest0-21swapper/308:17:483
11559559981,4cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional