You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Sun Jul 13, 2025 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
589902991413,0cyclictest0-21swapper/308:41:443
589902991413,0cyclictest0-21swapper/307:10:363
589902991313,0cyclictest0-21swapper/312:38:183
589902991312,0cyclictest0-21swapper/312:30:053
589902991312,0cyclictest0-21swapper/310:05:433
589902991312,0cyclictest0-21swapper/307:53:363
589902991212,0cyclictest0-21swapper/311:45:023
589902991212,0cyclictest0-21swapper/311:05:063
589902991212,0cyclictest0-21swapper/310:50:473
589902991212,0cyclictest0-21swapper/310:46:413
589902991212,0cyclictest0-21swapper/309:43:113
589902991212,0cyclictest0-21swapper/309:23:433
589902991212,0cyclictest0-21swapper/309:17:353
589902991212,0cyclictest0-21swapper/309:01:123
589902991212,0cyclictest0-21swapper/308:03:513
589902991212,0cyclictest0-21swapper/307:42:213
589902991211,0cyclictest0-21swapper/312:14:453
589902991211,0cyclictest0-21swapper/308:54:023
589902991210,1cyclictest0-21swapper/312:00:133
58990299120,8cyclictest0-21swapper/311:40:153
58990299120,11cyclictest69450irq/121-eno111:58:293
58990299120,11cyclictest69450irq/121-eno111:30:023
58990299120,11cyclictest69450irq/121-eno110:00:223
58990299120,11cyclictest69450irq/121-eno109:45:153
58990299120,11cyclictest0-21swapper/309:35:133
589902991111,0cyclictest0-21swapper/309:50:223
589902991111,0cyclictest0-21swapper/308:55:033
589902991111,0cyclictest0-21swapper/308:55:033
589902991111,0cyclictest0-21swapper/308:30:283
589902991111,0cyclictest0-21swapper/308:17:093
589902991110,1cyclictest69450irq/121-eno108:47:443
589902991110,0cyclictest0-21swapper/311:38:533
58990299110,8cyclictest0-21swapper/312:30:013
58990299110,11cyclictest0-21swapper/307:55:193
58990299110,10cyclictest69450irq/121-eno111:20:153
58990299110,10cyclictest69450irq/121-eno110:30:173
58990299110,10cyclictest69450irq/121-eno110:26:583
58990299110,10cyclictest0-21swapper/311:11:433
58990299110,10cyclictest0-21swapper/310:39:383
58990299110,10cyclictest0-21swapper/309:55:133
58990299110,10cyclictest0-21swapper/308:35:163
58990299110,0cyclictest0-21swapper/308:15:013
137398110,9rtkit-daemon545-21hwrng07:12:381
6193832100,0sleep30-21swapper/308:24:563
58990299109,0cyclictest69450irq/121-eno111:15:183
58990299109,0cyclictest0-21swapper/311:50:123
58990299109,0cyclictest0-21swapper/309:05:173
58990299108,2cyclictest69450irq/121-eno109:10:143
58990299108,1cyclictest0-21swapper/309:25:143
589902991010,0cyclictest69450irq/121-eno107:20:153
589902991010,0cyclictest0-21swapper/312:25:023
589902991010,0cyclictest0-21swapper/308:25:203
589902991010,0cyclictest0-21swapper/308:05:133
589902991010,0cyclictest0-21swapper/307:16:453
58990299100,0cyclictest0-21swapper/310:15:213
5899029999,0cyclictest0-21swapper/312:05:203
5899029999,0cyclictest0-21swapper/310:21:053
5899029999,0cyclictest0-21swapper/309:30:133
5899029999,0cyclictest0-21swapper/307:48:303
5899029999,0cyclictest0-21swapper/307:30:203
5899029999,0cyclictest0-21swapper/307:26:593
5899029998,1cyclictest69450irq/121-eno111:25:163
5899029998,0cyclictest0-21swapper/312:15:153
5899029998,0cyclictest0-21swapper/310:10:493
5899029988,0cyclictest0-21swapper/311:03:043
5899029988,0cyclictest0-21swapper/307:39:383
5899029987,0cyclictest0-21swapper/310:44:373
5899029980,0cyclictest0-21swapper/310:58:073
588922281,1sleep00-21swapper/007:05:200
588516270,4sleep1588669-21cat07:05:171
13739870,1rtkit-daemon754-21snmpd10:38:461
648339250,5sleep20-21swapper/209:36:432
588223251,2sleep30-21swapper/307:05:153
13739850,0rtkit-daemon0-21swapper/111:04:261
13739850,0rtkit-daemon0-21swapper/110:29:251
665891240,0sleep10-21swapper/110:20:131
644908241,1sleep1644934-21apt-get09:30:141
13739840,2rtkit-daemon702457-21ntp_states11:45:191
13739840,2rtkit-daemon636648-21diskmemload12:01:101
13739840,2rtkit-daemon609-21systemd-logind10:31:531
13739840,2rtkit-daemon606729-21ntp_states07:50:191
13739840,2rtkit-daemon1-21systemd12:21:261
13739840,2rtkit-daemon1-21systemd12:18:151
13739840,0rtkit-daemon0-21swapper/110:51:141
716340230,1sleep2716366-21apt-get12:20:142
610058230,1sleep2610084-21apt-get08:00:142
588056231,1sleep20-21swapper/207:05:022
13739830,2rtkit-daemon677-21gmain11:20:401
13739830,2rtkit-daemon575-21rpcbind09:03:201
13739830,2rtkit-daemon413-21systemd-journal07:30:051
13739830,2rtkit-daemon1-21systemd11:25:571
13739830,2rtkit-daemon1-21systemd08:39:121
13739830,2rtkit-daemon1-21systemd08:24:591
13739830,1rtkit-daemon756-21ntpd12:05:441
13739830,1rtkit-daemon756-21ntpd11:15:281
13739830,1rtkit-daemon756-21ntpd10:59:031
13739830,1rtkit-daemon754-21snmpd09:26:491
13739830,1rtkit-daemon677-21gmain12:32:561
13739830,1rtkit-daemon625427-21apt-get08:40:171
13739830,1rtkit-daemon595-21avahi-daemon09:24:181
13739830,1rtkit-daemon591881-21munin-node10:40:321
13739830,1rtkit-daemon591881-21munin-node09:55:271
13739830,1rtkit-daemon591881-21munin-node09:40:511
13739830,1rtkit-daemon328-21plymouthd09:37:501
13739830,1rtkit-daemon328-21plymouthd08:15:211
13739830,1rtkit-daemon1377-21sendmail-mta12:29:531
13739830,1rtkit-daemon1-21systemd11:58:511
13739830,1rtkit-daemon1-21systemd10:11:481
13739830,1rtkit-daemon1-21systemd09:49:031
13739830,1rtkit-daemon1-21systemd09:17:461
13739830,1rtkit-daemon1-21systemd09:05:311
13739830,1rtkit-daemon0-21swapper/111:50:291
13739830,1rtkit-daemon0-21swapper/111:05:131
13739830,0rtkit-daemon0-21swapper/111:30:241
722411220,0sleep00-21swapper/012:33:160
705898220,1sleep0706065-21grep11:55:140
705510222,0sleep00-21swapper/011:54:130
691090220,1sleep0691232-21ssh11:20:160
684428220,1sleep2684462-21munin-run11:05:012
676037220,0sleep00-21swapper/010:44:460
673926220,1sleep00-21swapper/010:39:460
667201222,0sleep00-21swapper/010:20:230
662728220,1sleep2663005-21users10:10:222
655803220,1sleep00-21swapper/009:55:190
654924220,1sleep20-21swapper/209:55:002
647322220,0sleep00-21swapper/009:35:170
619392220,1sleep0619409-21grep08:25:000
606420220,1sleep0606572-21memory07:50:190
600101220,1sleep00-21swapper/007:35:140
594650220,0sleep00-21swapper/007:20:170
13739820,1rtkit-daemon756-21ntpd07:35:181
13739820,1rtkit-daemon677-21gmain11:37:281
13739820,1rtkit-daemon677-21gmain08:25:441
13739820,1rtkit-daemon1377-21sendmail-mta08:10:031
13739820,1rtkit-daemon1377-21sendmail-mta07:25:161
13739820,1rtkit-daemon1-21systemd12:35:101
13739820,1rtkit-daemon1-21systemd11:40:261
13739820,1rtkit-daemon1-21systemd10:16:191
13739820,1rtkit-daemon1-21systemd07:45:411
13739820,0rtkit-daemon595-21avahi-daemon07:55:021
13739820,0rtkit-daemon328-21plymouthd12:11:051
13739820,0rtkit-daemon328-21plymouthd09:10:041
13739820,0rtkit-daemon0-21swapper/111:10:041
13739820,0rtkit-daemon0-21swapper/110:45:331
13739820,0rtkit-daemon0-21swapper/110:05:161
13739820,0rtkit-daemon0-21swapper/110:00:081
13739820,0rtkit-daemon0-21swapper/109:50:221
13739820,0rtkit-daemon0-21swapper/108:55:221
13739820,0rtkit-daemon0-21swapper/108:55:211
13739820,0rtkit-daemon0-21swapper/108:50:191
13739820,0rtkit-daemon0-21swapper/108:45:251
13739820,0rtkit-daemon0-21swapper/108:30:021
13739820,0rtkit-daemon0-21swapper/108:05:151
13739820,0rtkit-daemon0-21swapper/108:00:191
13739820,0rtkit-daemon0-21swapper/107:40:011
13739820,0rtkit-daemon0-21swapper/107:20:071
13739820,0rtkit-daemon0-21swapper/107:15:061
724235210,0sleep20-21swapper/212:35:552
723289211,0sleep0171ktimers/012:35:170
720964210,0sleep20-21swapper/212:30:142
718683210,1sleep00-21swapper/012:25:080
718177210,0sleep20-21swapper/212:25:022
717649210,1sleep00-21swapper/012:20:230
714357210,0sleep20-21swapper/212:15:172
714231210,0sleep00-21swapper/012:15:150
712641210,0sleep00-21swapper/012:10:190
712270210,0sleep20-21swapper/212:10:172
711511210,0sleep20-21swapper/212:06:442
710801210,0sleep00-21swapper/012:05:180
709422210,0sleep2709426-21ssh12:01:442
708588210,0sleep00-21swapper/012:00:190
706294210,0sleep20-21swapper/211:55:162
704210210,0sleep20-21swapper/211:50:152
702736210,0sleep00-21swapper/011:45:220
701780210,0sleep20-21swapper/211:45:162
699627210,0sleep20-21swapper/211:40:152
699053210,0sleep00-21swapper/011:39:560
698532210,0sleep20-21swapper/211:35:222
696730210,0sleep00-21swapper/011:32:530
695875210,0sleep20-21swapper/211:30:192
693738210,0sleep00-21swapper/011:25:200
693054210,0sleep20-21swapper/211:25:142
692672210,0sleep20-21swapper/211:23:532
690361210,0sleep00-21swapper/011:17:080
688076210,0sleep00-21swapper/011:10:230
686767210,0sleep20-21swapper/211:10:132
686066210,0sleep20-21swapper/211:06:042
684818210,0sleep00-21swapper/011:05:150
683937211,0sleep00-21swapper/011:00:420
681289210,0sleep20-21swapper/210:55:202
680493210,0sleep00-21swapper/010:55:140
680204210,0sleep20-21swapper/210:54:452
678434210,0sleep00-21swapper/010:50:140
676767210,0sleep20-21swapper/210:45:192
676069210,0sleep00-21swapper/010:45:010
675631210,0sleep20-21swapper/210:41:112
673736210,0sleep20-21swapper/210:38:042
670055210,0sleep00-21swapper/010:30:120
669396210,1sleep00-21swapper/010:26:250
667968210,0sleep20-21swapper/210:25:102
667064210,0sleep20-21swapper/210:20:222
664387210,0sleep00-21swapper/010:15:190
661867210,0sleep00-21swapper/010:10:160
660418210,0sleep20-21swapper/210:05:212
659642210,0sleep00-21swapper/010:05:140
657530210,0sleep00-21swapper/010:00:030
657012210,0sleep20-21swapper/210:00:002
651594210,0sleep00-21swapper/009:45:180
650444210,0sleep00-21swapper/009:42:140
646404210,0sleep20-21swapper/209:32:232
646341210,1sleep00-21swapper/009:31:450
644440210,0sleep00-21swapper/009:27:480
642237210,1sleep00-21swapper/009:20:400
639051210,0sleep20-21swapper/209:15:182
638876210,1sleep00-21swapper/009:15:080
638473210,1sleep00-21swapper/009:13:270
636891210,0sleep20-21swapper/209:10:142
635196210,0sleep00-21swapper/009:05:160
634728210,0sleep20-21swapper/209:05:012
634451210,1sleep00-21swapper/009:01:310
631284210,0sleep00-21swapper/008:55:150
631284210,0sleep00-21swapper/008:55:140
631129210,0sleep20-21swapper/208:55:122
631129210,0sleep20-21swapper/208:55:122
630612210,1sleep2328-21plymouthd08:51:372
630549210,0sleep00-21swapper/008:50:460
627594210,0sleep2627753-21fw_packets08:45:162
626131210,0sleep00-21swapper/008:40:220
625837210,0sleep20-21swapper/208:40:202
624924210,0sleep00-21swapper/008:37:250
623468210,0sleep20-21swapper/208:35:162
621978210,0sleep20-21swapper/208:30:152
621303210,0sleep00-21swapper/008:30:020
621008210,0sleep20-21swapper/208:26:152
619640210,0sleep00-21swapper/008:25:130
617757210,0sleep20-21swapper/208:20:142
615855210,0sleep00-21swapper/008:15:170
614652210,0sleep20-21swapper/208:10:182
614360210,0sleep00-21swapper/008:10:150
612977210,0sleep20-21swapper/208:05:212
610844210,0sleep00-21swapper/008:00:200
608383210,0sleep00-21swapper/007:55:140
607618210,0sleep20-21swapper/207:55:012
607515210,0sleep20-21swapper/207:53:442
602842210,0sleep00-21swapper/007:40:180
600255210,0sleep20-21swapper/207:35:152
599030210,0sleep20-21swapper/207:30:202
597939210,0sleep00-21swapper/007:30:010
597611210,1sleep00-21swapper/007:25:490
596993210,0sleep20-21swapper/207:25:192
594366210,0sleep20-21swapper/207:20:152
592849210,0sleep00-21swapper/007:15:160
592459210,0sleep20-21swapper/207:15:152
591094210,0sleep20-21swapper/207:10:222
699587200,0sleep00-21swapper/011:40:040
688604200,0sleep20-21swapper/211:15:022
670038200,0sleep20-21swapper/210:30:022
663783200,0sleep20-21swapper/210:15:012
655166200,0sleep20-21swapper/209:55:052
653070200,0sleep00-21swapper/009:50:010
650995200,0sleep20-21swapper/209:45:032
648920200,0sleep20-21swapper/209:40:042
642881200,0sleep20-21swapper/209:25:032
640692200,0sleep20-21swapper/209:20:022
633051200,0sleep20-21swapper/209:00:052
627110200,0sleep00-21swapper/008:45:010
615779200,0sleep20-21swapper/208:15:022
611959200,0sleep00-21swapper/008:05:030
604032200,0sleep20-21swapper/207:45:052
604030200,0sleep00-21swapper/007:45:030
602120200,0sleep20-21swapper/207:40:042
590038200,0sleep00-21swapper/007:10:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional