You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 22:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot3.osadl.org (updated Sat Nov 08, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
675995991610,4cyclictest0-21swapper/308:30:143
675995991511,3cyclictest0-21swapper/312:35:143
67599599130,12cyclictest0-21swapper/312:15:123
67599599130,11cyclictest0-21swapper/311:35:133
67599599130,11cyclictest0-21swapper/307:50:153
675995991210,1cyclictest0-21swapper/309:55:123
675995991210,1cyclictest0-21swapper/309:05:123
67599599120,1cyclictest0-21swapper/310:45:143
67599599120,1cyclictest0-21swapper/308:15:143
67599599120,1cyclictest0-21swapper/308:05:143
67599599120,11cyclictest0-21swapper/308:35:123
675995991111,0cyclictest69450irq/121-eno110:50:163
675995991111,0cyclictest69450irq/121-eno110:50:153
675995991111,0cyclictest69450irq/121-eno109:23:263
675995991111,0cyclictest0-21swapper/307:30:013
675995991110,0cyclictest0-21swapper/311:05:133
675995991110,0cyclictest0-21swapper/310:15:133
67599599110,8cyclictest0-21swapper/309:45:123
67599599110,8cyclictest0-21swapper/308:10:203
67599599110,10cyclictest69450irq/121-eno112:01:553
67599599110,10cyclictest69450irq/121-eno111:34:543
67599599110,10cyclictest69450irq/121-eno108:55:193
67599599109,0cyclictest0-21swapper/311:20:153
67599599109,0cyclictest0-21swapper/307:36:183
67599599108,2cyclictest69450irq/121-eno110:10:133
675995991010,0cyclictest69450irq/121-eno112:29:173
675995991010,0cyclictest69450irq/121-eno111:45:193
675995991010,0cyclictest69450irq/121-eno110:44:463
675995991010,0cyclictest69450irq/121-eno109:52:553
675995991010,0cyclictest69450irq/121-eno109:42:263
675995991010,0cyclictest69450irq/121-eno107:55:153
675995991010,0cyclictest69450irq/121-eno107:40:153
675995991010,0cyclictest69450irq/121-eno107:10:193
675995991010,0cyclictest0-21swapper/311:55:143
675995991010,0cyclictest0-21swapper/310:55:203
675995991010,0cyclictest0-21swapper/310:35:163
675995991010,0cyclictest0-21swapper/310:30:423
675995991010,0cyclictest0-21swapper/310:25:023
675995991010,0cyclictest0-21swapper/309:35:213
675995991010,0cyclictest0-21swapper/309:18:263
67599599100,9cyclictest69450irq/121-eno111:19:363
67599599100,0cyclictest0-21swapper/308:00:123
67599599100,0cyclictest0-21swapper/307:45:213
6759959999,0cyclictest69450irq/121-eno111:44:433
6759959999,0cyclictest69450irq/121-eno111:10:203
6759959999,0cyclictest69450irq/121-eno110:25:213
6759959999,0cyclictest69450irq/121-eno109:33:413
6759959999,0cyclictest69450irq/121-eno108:50:213
6759959999,0cyclictest0-21swapper/309:25:013
6759959998,0cyclictest0-21swapper/312:05:133
6759959998,0cyclictest0-21swapper/310:00:123
6759959998,0cyclictest0-21swapper/309:10:143
6759959990,8cyclictest69450irq/121-eno111:25:013
6759959990,8cyclictest69450irq/121-eno109:00:333
6759959990,8cyclictest69450irq/121-eno108:40:343
6759959990,8cyclictest0-21swapper/312:15:013
6759959990,8cyclictest0-21swapper/307:15:143
6759959980,6cyclictest0-21swapper/308:25:143
6759959977,0cyclictest69450irq/121-eno112:20:143
6759959977,0cyclictest69450irq/121-eno111:00:163
6759959977,0cyclictest69450irq/121-eno108:45:213
6759959966,0cyclictest69450irq/121-eno111:50:143
6759959966,0cyclictest69450irq/121-eno107:30:183
6759959966,0cyclictest0-21swapper/307:20:193
6759959955,0cyclictest0-21swapper/310:05:123
6759959950,4cyclictest69450irq/121-eno112:30:163
6759959950,4cyclictest69450irq/121-eno108:20:133
678644240,1sleep0678670-21apt-get07:15:110
675656242,1sleep20-21swapper/207:09:242
675441242,1sleep10-21swapper/107:06:351
674035241,2sleep30-21swapper/307:05:043
801032230,2sleep2801103-21aten_r1power_en12:15:122
764640230,2sleep0764645-21turbostat.cron10:49:570
713811230,1sleep1713837-21apt-get08:45:141
708051230,1sleep2708077-21apt-get08:30:142
673834231,1sleep00-21swapper/007:05:010
809165220,1sleep2809262-21cut12:35:002
805239220,0sleep10-21swapper/112:25:161
795385220,1sleep2795534-21ntp_states12:00:192
794764220,1sleep10-21swapper/112:00:141
785315220,0sleep00-21swapper/011:35:240
779575220,1sleep20-21swapper/211:25:162
773281220,1sleep00-21swapper/011:10:140
771812220,0sleep00-21swapper/011:05:170
768713220,0sleep00-21swapper/010:59:010
758274220,0sleep00-21swapper/010:34:110
753476220,1sleep0753701-21vmstat10:20:230
746157220,0sleep00-21swapper/010:05:140
718948220,0sleep00-21swapper/008:55:280
715723220,0sleep00-21swapper/008:50:130
701341220,0sleep00-21swapper/008:10:230
698981220,1sleep0699173-21strings08:05:180
690966220,1sleep2691228-21df_inode07:45:182
688219220,0sleep10-21swapper/107:36:171
680314221,0sleep2680491-21latency_hist07:20:012
677916220,0sleep00-21swapper/007:14:460
810199210,0sleep10-21swapper/112:35:191
810067210,0sleep00-21swapper/012:35:180
807516210,0sleep10-21swapper/112:30:161
807386210,0sleep00-21swapper/012:30:150
806889210,0sleep00-21swapper/012:28:260
805268210,0sleep20-21swapper/212:25:172
804052210,0sleep20-21swapper/212:20:192
803271210,0sleep10-21swapper/112:20:141
803173210,0sleep00-21swapper/012:20:130
801967210,0sleep10-21swapper/112:15:191
801288210,0sleep00-21swapper/012:15:140
800269210,0sleep00-21swapper/012:10:330
798948210,0sleep10-21swapper/112:10:141
798941210,0sleep20-21swapper/212:10:112
797550210,0sleep10-21swapper/112:05:171
797359210,0sleep0797547-21grep12:05:170
797010210,0sleep20-21swapper/212:05:142
795664210,0sleep00-21swapper/012:00:210
793706210,1sleep00-21swapper/011:55:280
793468210,0sleep20-21swapper/211:55:222
792818210,0sleep10-21swapper/111:55:171
790736210,0sleep10-21swapper/111:50:171
790471210,0sleep00-21swapper/011:50:160
790304210,0sleep20-21swapper/211:50:132
789350210,0sleep10-21swapper/111:45:211
788239210,0sleep20-21swapper/211:45:142
788204210,0sleep00-21swapper/011:45:070
787686210,0sleep20-21swapper/211:42:372
786310210,0sleep00-21swapper/011:40:150
785424210,0sleep20-21swapper/211:36:182
783311210,0sleep20-21swapper/211:31:042
782359210,0sleep10-21swapper/111:30:151
781902210,0sleep00-21swapper/011:30:020
780375210,0sleep00-21swapper/011:25:230
780008210,0sleep10-21swapper/111:25:191
779303210,0sleep20-21swapper/211:24:572
779047211,0sleep1769098-21kworker/u16:0+xprtiod11:22:401
777206210,0sleep00-21swapper/011:20:030
775523210,0sleep20-21swapper/211:15:152
775460210,0sleep10-21swapper/111:15:141
775366210,0sleep00-21swapper/011:15:130
773215210,0sleep10-21swapper/111:10:031
772521210,0sleep10-21swapper/111:05:351
772089210,0sleep20-21swapper/211:05:202
770695210,0sleep20-21swapper/211:02:502
769870210,0sleep00-21swapper/011:00:200
769399210,0sleep10-21swapper/111:00:171
766988210,0sleep20-21swapper/210:55:112
766978210,0sleep10-21swapper/110:55:061
766225210,0sleep20-21swapper/210:50:302
766225210,0sleep20-21swapper/210:50:302
765344210,0sleep00-21swapper/010:50:170
765344210,0sleep00-21swapper/010:50:160
764908210,0sleep10-21swapper/110:50:131
764908210,0sleep10-21swapper/110:50:131
764072210,0sleep20-21swapper/210:45:222
763269210,0sleep10-21swapper/110:45:171
760872210,0sleep00-21swapper/010:40:150
760732210,0sleep10-21swapper/110:40:121
760719210,0sleep20-21swapper/210:40:052
759973210,0sleep00-21swapper/010:35:440
759064210,0sleep20-21swapper/210:35:172
758617210,0sleep10-21swapper/110:35:091
757934210,0sleep10-21swapper/110:31:001
756552210,0sleep20-21swapper/210:30:132
755824210,0sleep20-21swapper/210:25:482
754527210,0sleep10-21swapper/110:25:151
754104210,0sleep20-21swapper/210:24:052
753710210,0sleep10-21swapper/110:20:281
752054210,0sleep10-21swapper/110:19:271
751231210,0sleep20-21swapper/210:15:192
750326210,0sleep00-21swapper/010:15:130
749692210,0sleep10-21swapper/110:11:541
749354210,0sleep20-21swapper/210:10:232
748213210,0sleep00-21swapper/010:10:140
746929210,0sleep20-21swapper/210:05:202
745432210,1sleep00-21swapper/010:01:050
744699210,0sleep10-21swapper/110:00:171
744196210,0sleep20-21swapper/210:00:142
743265210,0sleep00-21swapper/009:55:370
743180210,0sleep10-21swapper/109:55:221
742699210,0sleep20-21swapper/209:55:182
741164210,0sleep20-21swapper/209:50:312
740221210,0sleep00-21swapper/009:50:160
739845210,0sleep10-21swapper/109:50:141
739114210,1sleep00-21swapper/009:45:480
737846210,0sleep20-21swapper/209:45:142
737756210,0sleep10-21swapper/109:45:131
737273210,1sleep1737275-21ssh09:43:011
736651210,0sleep20-21swapper/209:40:222
735668210,1sleep00-21swapper/009:40:040
734356210,0sleep20-21swapper/209:35:222
733644210,0sleep10-21swapper/109:35:161
733634210,0sleep00-21swapper/009:35:110
733307210,0sleep10-21swapper/109:34:161
731842210,0sleep00-21swapper/009:30:160
731657210,0sleep2731699-21aten_r1power_cu09:30:132
731002210,1sleep00-21swapper/009:25:350
730636210,0sleep10-21swapper/109:25:201
729664210,1sleep2729745-21cut09:25:132
729154210,0sleep2729194-21gpgv09:25:002
728949210,0sleep10-21swapper/109:22:471
727562210,0sleep00-21swapper/009:20:140
727038210,0sleep00-21swapper/009:18:550
726900210,0sleep10-21swapper/109:17:281
725395210,0sleep20-21swapper/209:15:122
724133210,0sleep10-21swapper/109:10:191
723922210,0sleep00-21swapper/009:10:170
722390210,0sleep20-21swapper/209:05:232
722204210,0sleep00-21swapper/009:05:210
719572210,0sleep20-21swapper/209:00:162
718834210,0sleep20-21swapper/208:55:222
718606210,0sleep10-21swapper/108:55:211
716369210,0sleep10-21swapper/108:50:171
715401210,0sleep00-21swapper/008:49:050
713839210,0sleep20-21swapper/208:45:152
713278210,1sleep00-21swapper/008:41:200
711630210,0sleep10-21swapper/108:40:001
710943210,0sleep10-21swapper/108:35:211
710222210,0sleep00-21swapper/008:35:160
709966210,0sleep20-21swapper/208:35:132
709441210,1sleep00-21swapper/008:31:270
708473210,0sleep10-21swapper/108:30:161
707454210,1sleep00-21swapper/008:25:310
706560210,0sleep10-21swapper/108:25:201
705706210,0sleep10-21swapper/108:22:401
704223210,0sleep20-21swapper/208:20:132
704211210,1sleep00-21swapper/008:20:030
703618210,1sleep00-21swapper/008:15:420
702422210,0sleep10-21swapper/108:15:151
702038210,0sleep20-21swapper/208:15:002
700405210,0sleep20-21swapper/208:10:162
700376210,0sleep10-21swapper/108:10:151
698523210,0sleep10-21swapper/108:05:151
696973210,0sleep20-21swapper/208:00:152
696673210,0sleep10-21swapper/108:00:141
696579210,0sleep00-21swapper/008:00:130
695662210,0sleep20-21swapper/207:55:242
694747210,0sleep00-21swapper/007:55:180
693680210,0sleep10-21swapper/107:50:211
692712210,0sleep20-21swapper/207:50:152
692457210,0sleep00-21swapper/007:50:000
690797210,0sleep10-21swapper/107:45:131
688972210,0sleep20-21swapper/207:40:152
688608210,0sleep00-21swapper/007:40:010
687590210,0sleep20-21swapper/207:35:182
687289210,0sleep00-21swapper/007:35:160
686114210,1sleep00-21swapper/007:32:120
685184210,0sleep1685381-21strings07:30:201
682497210,0sleep20-21swapper/207:25:142
681551210,0sleep00-21swapper/007:20:190
678673210,0sleep10-21swapper/107:15:121
676704210,0sleep10-21swapper/107:10:161
676271210,0sleep20-21swapper/207:10:132
809401200,0sleep20-21swapper/212:35:042
786110200,0sleep10-21swapper/111:40:041
783998200,0sleep10-21swapper/111:35:051
773263200,0sleep20-21swapper/211:10:032
754445200,0sleep00-21swapper/010:25:020
746111200,0sleep10-21swapper/110:05:031
723386200,0sleep20-21swapper/209:10:042
721470200,0sleep10-21swapper/109:05:021
719555200,0sleep10-21swapper/109:00:031
719301200,0sleep00-21swapper/009:00:020
715710200,0sleep20-21swapper/208:50:022
711885200,0sleep20-21swapper/208:40:012
705889200,0sleep20-21swapper/208:25:012
698451200,0sleep20-21swapper/208:05:042
694603200,0sleep10-21swapper/107:55:031
690543200,0sleep00-21swapper/007:45:000
688862200,0sleep10-21swapper/107:40:021
684657200,0sleep20-21swapper/207:30:012
682485200,0sleep10-21swapper/107:25:051
682484200,0sleep00-21swapper/007:25:040
680572200,0sleep20-21swapper/207:20:052
680571200,0sleep10-21swapper/107:20:041
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional